-- Logs begin at Thu 2022-08-25 04:20:58 UTC, end at Thu 2022-08-25 05:32:30 UTC. -- Aug 25 04:51:59.838848 dv-cinder-853910-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 25 04:51:59.847376 dv-cinder-853910-2-smb devstack@keystone.service[81737]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 04:51:59 2022] *** Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: nodename: dv-cinder-853910-2-smb Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: machine: x86_64 Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: clock source: unix Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: pcre jit disabled Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: detected number of CPU cores: 4 Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: current working directory: / Aug 25 04:51:59.849609 dv-cinder-853910-2-smb devstack@keystone.service[81737]: detected binary path: /usr/bin/uwsgi-core Aug 25 04:51:59.850158 dv-cinder-853910-2-smb devstack@keystone.service[81737]: your processes number limit is 47680 Aug 25 04:51:59.850158 dv-cinder-853910-2-smb devstack@keystone.service[81737]: your memory page size is 4096 bytes Aug 25 04:51:59.850158 dv-cinder-853910-2-smb devstack@keystone.service[81737]: detected max file descriptor number: 2048 Aug 25 04:51:59.850158 dv-cinder-853910-2-smb devstack@keystone.service[81737]: lock engine: pthread robust mutexes Aug 25 04:51:59.850158 dv-cinder-853910-2-smb devstack@keystone.service[81737]: thunder lock: enabled Aug 25 04:51:59.850158 dv-cinder-853910-2-smb devstack@keystone.service[81737]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 25 04:51:59.850158 dv-cinder-853910-2-smb devstack@keystone.service[81737]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 04:51:59.889363 dv-cinder-853910-2-smb devstack@keystone.service[81737]: Python main interpreter initialized at 0x55bad3bde9c0 Aug 25 04:51:59.889363 dv-cinder-853910-2-smb devstack@keystone.service[81737]: python threads support enabled Aug 25 04:51:59.889363 dv-cinder-853910-2-smb devstack@keystone.service[81737]: your server socket listen backlog is limited to 100 connections Aug 25 04:51:59.889363 dv-cinder-853910-2-smb devstack@keystone.service[81737]: your mercy for graceful operations on workers is 90 seconds Aug 25 04:51:59.889736 dv-cinder-853910-2-smb devstack@keystone.service[81737]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 04:51:59.889812 dv-cinder-853910-2-smb devstack@keystone.service[81737]: *** Operational MODE: preforking *** Aug 25 04:51:59.890049 dv-cinder-853910-2-smb devstack@keystone.service[81737]: *** uWSGI is running in multiple interpreter mode *** Aug 25 04:51:59.890049 dv-cinder-853910-2-smb devstack@keystone.service[81737]: spawned uWSGI master process (pid: 81737) Aug 25 04:51:59.890249 dv-cinder-853910-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 25 04:51:59.891340 dv-cinder-853910-2-smb devstack@keystone.service[81737]: spawned uWSGI worker 1 (pid: 81749, cores: 1) Aug 25 04:51:59.891340 dv-cinder-853910-2-smb devstack@keystone.service[81737]: spawned uWSGI worker 2 (pid: 81750, cores: 1) Aug 25 04:51:59.891340 dv-cinder-853910-2-smb devstack@keystone.service[81737]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 04:52:04.236294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 04:52:04.236294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: from cryptography.utils import int_from_bytes Aug 25 04:52:04.237068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 04:52:04.237068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: from cryptography.utils import int_from_bytes Aug 25 04:52:04.237475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 04:52:04.237475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: from cryptography.utils import int_from_bytes Aug 25 04:52:04.237583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 04:52:04.237583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: from cryptography.utils import int_from_bytes Aug 25 04:52:04.287537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 04:52:04.287699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 04:52:04.287789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 04:52:04.287875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 04:52:04.287975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] command line args: [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 04:52:04.288054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] command line args: [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 04:52:04.288195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 04:52:04.288273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 04:52:04.288375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ================================================================================ {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 04:52:04.288458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ================================================================================ {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 04:52:04.288633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] admin_token = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.288725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] admin_token = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.288878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] config_dir = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.288961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] config_dir = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] config_source = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] config_source = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] debug = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] debug = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.289985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.290914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] list_limit = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] list_limit = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] log_config_append = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] log_config_append = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] log_dir = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] log_dir = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] log_file = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] log_file = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.291834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292191 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.292929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.293984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.294895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] publish_errors = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] publish_errors = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.295894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.296988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] standard_threads = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] standard_threads = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.297900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] use_journal = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] use_journal = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] use_json = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] use_json = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] use_stderr = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] use_stderr = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] use_syslog = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.298902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] use_syslog = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.299026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.299139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 04:52:04.299252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.299363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.299476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.299598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.299718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.299831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.299968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.300905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.301952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.302985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.303937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.304945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.305057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.305178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.305292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.305407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.305519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.305631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.305743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.306370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.306489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.306603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.306714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.306833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.306947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.307882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.308977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309567 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.309965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310798 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.310918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.311927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.312990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.313123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.313367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.313594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.313716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.313830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.313942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.314888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.315008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.315131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.315245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.315482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.315736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.316005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.316248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.316494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.316695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.316900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.317960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.318903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.319032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.319146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.319259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.319259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.319471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.319717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.319990 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.320237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.320479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.320725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.320840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.321092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.321221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.321338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.321611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.322233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.322421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.322537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.322833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.322953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.323094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.323212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.323348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.323613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.323820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.324049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.324242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.324430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.324614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.324796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.325008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.325197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.325390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.325589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.325780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.325970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.326173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.326364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.326548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.326732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.326919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.327102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.327310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.327508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.327698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] auth.external = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.327890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.328146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.328340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.328494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.328614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.328728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.328950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] auth.password = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] auth.token = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.329909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.330888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] credential.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.331945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] auth.external = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.332747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] auth.password = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.333957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] auth.token = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.334413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.335357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.335553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.335673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.335788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.335964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.336927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.337043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] credential.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.337203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.337379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.337580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.337580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.338022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.338222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.338425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.338619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.338859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339528 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.339919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.340999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.341896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.342930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343261 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.343960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.344995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.345919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.346939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.347862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.348002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.348117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.348490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.348610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.348725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.348838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.348952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.349987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.350915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.351833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.352029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.352151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.352286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.352536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.352653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.352815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.352941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.353256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.353373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.353488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.353608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.353723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.353846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.353962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.354909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.355027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.355162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.355304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.355419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.355534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.355654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.355769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.356944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.357982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.358898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.359873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.360947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.361983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] role.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] role.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.362904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.363953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.364885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.365935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.366969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] role.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] role.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.367994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.368114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.368230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.368829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.368947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.369921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.370999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.371113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.371236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.371435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.371554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.371668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.371782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.371895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.372889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.373916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.374991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.connection = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.375951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.376891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.377937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.378977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.379091 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.379214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.379330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.379444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.379557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.379743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.379869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.380013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.380129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.380255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81749) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 04:52:04.380372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.connection = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.380486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.380676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.380920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.381165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.381405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.381645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.381883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.382123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.382371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.382612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.382860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.383098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.383349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.383589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.383836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.384709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.384956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.385249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 04:52:04.385423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81750) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 04:52:04.410130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.410360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.410588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.411228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.411465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.411695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.419071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.420330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.448277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.448503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.449389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.449624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.502090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.502301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.551017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.551253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.551337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.551543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.710153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.710389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.710568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.710660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.710805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.710893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.711026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.711110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.711245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.711338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.711465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.711680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.735513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.735693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.735781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.735972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.736926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.737143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.748519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.748922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.761474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.761658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.761830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.761916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81749) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.762987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.763204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81750) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 04:52:04.779546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.779758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 04:52:04.779844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.780131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 04:52:04.780215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.780329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 04:52:04.780484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.780607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.780689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 04:52:04.780873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.780964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.781202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.781384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.781651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.781732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.782213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.791538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.791817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.792001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.792119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.792286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.806628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.806776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.806776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.807035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.807250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.807381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.807381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.807584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.807664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.807738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.807810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.807892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.808964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.828404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.828707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.829872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.830296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.830436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.830576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.834811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.835098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.835223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.835384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.835533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.835684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.841937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.842112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.842223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.842463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.846322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.846502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.846615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.846796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.846903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.847083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.847193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.847370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.847471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.847650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.847754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.847944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.848034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.848219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.848554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.848767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.866491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.866686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.866781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.866887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.871248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.871363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.874496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.874644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.874796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.874946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.879005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.879153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.882153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.882291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.885541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.885657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.885841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.885934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.886133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.886229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.886425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.886509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.886708 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.886791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.887010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.887094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.902951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.903051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.903240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.903322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.903521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.903603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.903798 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.903880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.910693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.913104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.913104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.913269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.913344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.913418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.915134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.915771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.916068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.916154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.916427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.916510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.916715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.916800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.916996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.917080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.928348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.928497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.928630 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.928713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.928913 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.928999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.929194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.929277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.929474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.929555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.929748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.929829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.930025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.930108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.945859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.946028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.949065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.949318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.951964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.952224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.953411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.953662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.954883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.955138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.955265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.955424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.955563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.955734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.961922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.962447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.963502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.963916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.966412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.966703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.966865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.966989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.967160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.967276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.967450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.967729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.975455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.975756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.975969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.976067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.976268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.976576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.983574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81749) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.983861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.984169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.984251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81750) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 04:52:04.984450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.984540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.984729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.984817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.985907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.986106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.986186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.986381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.986462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.986645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.986727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.986918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.987068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.987183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.987264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81749) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.987457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:04.987729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81750) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 04:52:05.021523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bad3bde9c0 pid: 81749 (default app) Aug 25 04:52:05.022589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bad3bde9c0 pid: 81750 (default app) Aug 25 04:52:05.025449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a4cf6-04b9-4e7d-9501-3d5c4e61dcef None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:05.025769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a4cf6-04b9-4e7d-9501-3d5c4e61dcef None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:05.026015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a4cf6-04b9-4e7d-9501-3d5c4e61dcef None None] PATH_INFO: `/v3` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:05.030232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Thu Aug 25 04:52:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:12.732538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422e44-d53b-4a00-a551-70bb4bfe539a None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:12.733062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422e44-d53b-4a00-a551-70bb4bfe539a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:12.733062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422e44-d53b-4a00-a551-70bb4bfe539a None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:12.737337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:12.742698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:12.743139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:12.743347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:12.814599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: INFO dbcounter [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] Registered counter for database keystone Aug 25 04:52:12.835229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG oslo_db.sqlalchemy.engines [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81749) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 04:52:12.841948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writer thread running {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 04:52:13.023225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG passlib.handlers.bcrypt [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81749) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 04:52:13.023646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG passlib.handlers.bcrypt [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81749) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 04:52:13.081436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:13.083068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:13.214449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 04:52:13.517752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422e44-d53b-4a00-a551-70bb4bfe539a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:13.587541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: INFO dbcounter [None req-5d422e44-d53b-4a00-a551-70bb4bfe539a None None] Registered counter for database keystone Aug 25 04:52:13.607737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG oslo_db.sqlalchemy.engines [None req-5d422e44-d53b-4a00-a551-70bb4bfe539a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81750) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 04:52:13.614003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writer thread running {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 04:52:13.743240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422e44-d53b-4a00-a551-70bb4bfe539a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:13.747586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9382bb7-a3a6-49ce-8df2-9680764ca3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:13.748252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382bb7-a3a6-49ce-8df2-9680764ca3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:13.748528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382bb7-a3a6-49ce-8df2-9680764ca3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:13.748797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9382bb7-a3a6-49ce-8df2-9680764ca3d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:13.756883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382bb7-a3a6-49ce-8df2-9680764ca3d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:13.809867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e9382bb7-a3a6-49ce-8df2-9680764ca3d4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 04:52:13.810161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9382bb7-a3a6-49ce-8df2-9680764ca3d4 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:13.819636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Aug 25 04:52:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 04:52:13.826414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:13.841304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739ac2-60bc-4eb4-a260-60c6167698b5 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:13.845736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3e9c3-240c-4300-ae92-84bd741419d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:13.846870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e9c3-240c-4300-ae92-84bd741419d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:13.847179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e9c3-240c-4300-ae92-84bd741419d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:13.847456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3e9c3-240c-4300-ae92-84bd741419d7 admin admin] PATH_INFO: `/v3/projects/1aab57a271ef4e04a301d0c13f37422d` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:13.849312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3e9c3-240c-4300-ae92-84bd741419d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1aab57a271ef4e04a301d0c13f37422d)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:13.903430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING keystone.common.rbac_enforcer.enforcer [None req-26b3e9c3-240c-4300-ae92-84bd741419d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 04:52:13.903768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3e9c3-240c-4300-ae92-84bd741419d7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:13.908357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Thu Aug 25 04:52:13 2022] GET /identity/v3/projects/1aab57a271ef4e04a301d0c13f37422d => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:15.788312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6097f5-e7d4-4d79-927f-21766e0a1bd5 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:15.788822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6097f5-e7d4-4d79-927f-21766e0a1bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:15.788907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6097f5-e7d4-4d79-927f-21766e0a1bd5 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:15.793323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:15.798585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19058c2a-4cb3-49b9-b333-5de7fe33dd0f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:15.799007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19058c2a-4cb3-49b9-b333-5de7fe33dd0f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:15.799126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19058c2a-4cb3-49b9-b333-5de7fe33dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:15.819250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-19058c2a-4cb3-49b9-b333-5de7fe33dd0f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:15.820810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-19058c2a-4cb3-49b9-b333-5de7fe33dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:15.829342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 04:52:16.094142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6097f5-e7d4-4d79-927f-21766e0a1bd5 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:16.107150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6097f5-e7d4-4d79-927f-21766e0a1bd5 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:16.111385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e0365-82ee-4d5d-a4e2-6aefaeb90be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:16.112010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e0365-82ee-4d5d-a4e2-6aefaeb90be8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:16.112294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e0365-82ee-4d5d-a4e2-6aefaeb90be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:16.112568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e0365-82ee-4d5d-a4e2-6aefaeb90be8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:16.120701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e0365-82ee-4d5d-a4e2-6aefaeb90be8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:16.122495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e0365-82ee-4d5d-a4e2-6aefaeb90be8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:16.131219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Thu Aug 25 04:52:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 04:52:16.136527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19058c2a-4cb3-49b9-b333-5de7fe33dd0f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:16.145530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19058c2a-4cb3-49b9-b333-5de7fe33dd0f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:16.150041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e5afd-f7dd-4226-9449-bca9961a1bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:16.150664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5afd-f7dd-4226-9449-bca9961a1bae admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:16.150946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5afd-f7dd-4226-9449-bca9961a1bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:16.151219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5afd-f7dd-4226-9449-bca9961a1bae admin admin] PATH_INFO: `/v3/users/dde84621695a4b64985c2f72dbefe3be` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:16.152564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e5afd-f7dd-4226-9449-bca9961a1bae admin admin] RBAC: Authorizing `identity:get_user(user_id=dde84621695a4b64985c2f72dbefe3be)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:16.154398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e5afd-f7dd-4226-9449-bca9961a1bae admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:16.155929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Thu Aug 25 04:52:16 2022] GET /identity/v3/users/dde84621695a4b64985c2f72dbefe3be => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:18.137414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bbd2c-4f6c-4af4-abe9-31dd81385c3b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:18.143872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bbd2c-4f6c-4af4-abe9-31dd81385c3b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:18.143872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bbd2c-4f6c-4af4-abe9-31dd81385c3b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:18.143872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:18.144346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab41b4-988e-48b2-8424-481cca7eca00 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:18.144726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab41b4-988e-48b2-8424-481cca7eca00 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:18.144897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab41b4-988e-48b2-8424-481cca7eca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:18.163768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3cab41b4-988e-48b2-8424-481cca7eca00 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:18.165482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3cab41b4-988e-48b2-8424-481cca7eca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:18.245845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:18.305776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88416ac-09c7-4532-a721-4bbb6285c312 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:18.306221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88416ac-09c7-4532-a721-4bbb6285c312 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:18.306569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88416ac-09c7-4532-a721-4bbb6285c312 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:18.308006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 6/12] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:18.313145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d4060-c694-4ce9-9e96-9876d9b9015a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:18.313434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d4060-c694-4ce9-9e96-9876d9b9015a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:18.313707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d4060-c694-4ce9-9e96-9876d9b9015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:18.332135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2d5d4060-c694-4ce9-9e96-9876d9b9015a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:18.333320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2d5d4060-c694-4ce9-9e96-9876d9b9015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:18.350198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:18.405031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:18.517449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88416ac-09c7-4532-a721-4bbb6285c312 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:18.658330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88416ac-09c7-4532-a721-4bbb6285c312 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:18.670903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d4060-c694-4ce9-9e96-9876d9b9015a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:18.693674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:18.694556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:18.694840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:18.695119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:18.707411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:18.716260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:18.717391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:18.718321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:18.722991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:18.759761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:18.779030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d4060-c694-4ce9-9e96-9876d9b9015a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:18.814674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:18.815290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:18.815568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:18.815846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:18.827596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d39749-2ef0-48fa-8a80-61abec9136f3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:18.837566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:18.861270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:18.861882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:18.862161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:18.862434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:18.863100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:18.863401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:18.864838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:18.877364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:18.882800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:18.885779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:18.887275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:18.977126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:18.983625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ff8c-58b3-410c-8fa3-41df65f89773 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:18.986651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 04:52:18.992458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:19.019064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:19.019685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:19.019995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:19.020265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] PATH_INFO: `/v3/users/dde84621695a4b64985c2f72dbefe3be` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:19.021805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] RBAC: Authorizing `identity:get_user(user_id=dde84621695a4b64985c2f72dbefe3be)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:19.023258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:19.025837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:18 2022] GET /identity/v3/users/dde84621695a4b64985c2f72dbefe3be => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:19.030956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:19.043459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:19.091067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7fee3-b376-485d-af57-f048e8407f18 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:19.124864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:19.125569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:19.125851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:19.126120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:19.130713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07eddb1-5c76-4415-91f1-0dbc1791ac94 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:19.137426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:19.138906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:52:19.156002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:19.157484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:52:19.158505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:52:19.158505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:52:19.158505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:19.158505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:52:19.162770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:19.167135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:19.167769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:19.168075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:19.168348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:19.169557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:19.171010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:19.172603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:19.178179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:19.208953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:19.267956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170b23-654f-42cd-912a-78ea9c919452 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:19.270403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:19.279218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3bdc3-f1d4-4130-80c9-5865ccd4a1dc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:19.303087 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1314d-0d21-4bb9-9a0b-f34e86c41ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:19.303694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1314d-0d21-4bb9-9a0b-f34e86c41ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:19.303997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1314d-0d21-4bb9-9a0b-f34e86c41ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:19.304272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1314d-0d21-4bb9-9a0b-f34e86c41ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:19.304911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1314d-0d21-4bb9-9a0b-f34e86c41ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:19.305214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1314d-0d21-4bb9-9a0b-f34e86c41ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:19.306649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1314d-0d21-4bb9-9a0b-f34e86c41ac7 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:19.313900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed813e9-520a-402f-904c-29242637e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:19.314506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed813e9-520a-402f-904c-29242637e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:19.314788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed813e9-520a-402f-904c-29242637e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:19.315064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed813e9-520a-402f-904c-29242637e9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:19.315785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed813e9-520a-402f-904c-29242637e9f9 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.domain.id=default, user.id=dde84621695a4b64985c2f72dbefe3be) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:19.317100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed813e9-520a-402f-904c-29242637e9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:19.317582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed813e9-520a-402f-904c-29242637e9f9 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:19.324838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 10/20] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:19.325984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 11/21] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Aug 25 04:52:19 2022] GET /identity/v3/role_assignments?user.id=dde84621695a4b64985c2f72dbefe3be&scope.domain.id=default&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:21.420587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cd18-6d23-4a40-8ade-bb63652939d6 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:21.421619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cd18-6d23-4a40-8ade-bb63652939d6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:21.422117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cd18-6d23-4a40-8ade-bb63652939d6 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:21.423664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 11/22] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:21.430045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7add6-c1aa-4a6a-8cfd-fe64068a33f1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:21.430807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7add6-c1aa-4a6a-8cfd-fe64068a33f1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:21.430807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7add6-c1aa-4a6a-8cfd-fe64068a33f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:21.451630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG passlib.handlers.bcrypt [None req-b4f7add6-c1aa-4a6a-8cfd-fe64068a33f1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81750) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 04:52:21.452084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG passlib.handlers.bcrypt [None req-b4f7add6-c1aa-4a6a-8cfd-fe64068a33f1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81750) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 04:52:21.501016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b4f7add6-c1aa-4a6a-8cfd-fe64068a33f1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:21.502652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b4f7add6-c1aa-4a6a-8cfd-fe64068a33f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:21.615013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:21.640394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb876-6e93-4d41-9bdf-46d61ef31aa9 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:21.640712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb876-6e93-4d41-9bdf-46d61ef31aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:21.640954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb876-6e93-4d41-9bdf-46d61ef31aa9 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:21.642450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:21.647758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adefba-254c-4435-a38f-d8c3c9393c25 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:21.648089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adefba-254c-4435-a38f-d8c3c9393c25 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:21.648366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adefba-254c-4435-a38f-d8c3c9393c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:21.676995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-56adefba-254c-4435-a38f-d8c3c9393c25 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:21.678145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-56adefba-254c-4435-a38f-d8c3c9393c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:21.703367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:21.769539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:22.074480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bb876-6e93-4d41-9bdf-46d61ef31aa9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:22.100981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a40d3-fc54-42ab-aaac-e5d53cce84b8 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.101628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a40d3-fc54-42ab-aaac-e5d53cce84b8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.102639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a40d3-fc54-42ab-aaac-e5d53cce84b8 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.104872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 14/26] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:22.112922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095178-dcc5-4bc4-b744-f5d426874f5a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.113481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095178-dcc5-4bc4-b744-f5d426874f5a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.113958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095178-dcc5-4bc4-b744-f5d426874f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.149054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e5095178-dcc5-4bc4-b744-f5d426874f5a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:22.151414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e5095178-dcc5-4bc4-b744-f5d426874f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:22.237165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bb876-6e93-4d41-9bdf-46d61ef31aa9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:22.263971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 15/27] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 25 04:52:22.265067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095178-dcc5-4bc4-b744-f5d426874f5a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:22.337670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbfa69-b404-43dc-a876-7164e8e70fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:22.338005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfa69-b404-43dc-a876-7164e8e70fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.338215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfa69-b404-43dc-a876-7164e8e70fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.338484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbfa69-b404-43dc-a876-7164e8e70fa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.361314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbfa69-b404-43dc-a876-7164e8e70fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-59fbfa69-b404-43dc-a876-7164e8e70fa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:22.367591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:22.369394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:22.370199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 13/28] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:22.370848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206188-226a-4ed1-8e44-6250a3e44109 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.371421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206188-226a-4ed1-8e44-6250a3e44109 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.371421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206188-226a-4ed1-8e44-6250a3e44109 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.373112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 14/29] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:22.377907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206188-226a-4ed1-8e44-6250a3e44109 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:22.401803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:22.419328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095178-dcc5-4bc4-b744-f5d426874f5a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:22.428305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:22.459061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a61fd-b3f4-4906-8524-50984da7bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:22.460415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a61fd-b3f4-4906-8524-50984da7bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.460922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a61fd-b3f4-4906-8524-50984da7bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.461971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a61fd-b3f4-4906-8524-50984da7bbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.494833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a61fd-b3f4-4906-8524-50984da7bbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:22.496804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a61fd-b3f4-4906-8524-50984da7bbb2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-8b1a61fd-b3f4-4906-8524-50984da7bbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:52:22.514056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:22.514967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:52:22.515781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:52:22.515781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:52:22.515781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:22.517901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 16/30] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:22.519340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87624de6-5dad-4eaa-a02f-eb569b918193 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.519827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87624de6-5dad-4eaa-a02f-eb569b918193 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.520329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87624de6-5dad-4eaa-a02f-eb569b918193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.541980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-87624de6-5dad-4eaa-a02f-eb569b918193 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:22.543568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-87624de6-5dad-4eaa-a02f-eb569b918193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:22.601706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206188-226a-4ed1-8e44-6250a3e44109 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:22.622828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 17/31] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:22.624219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87624de6-5dad-4eaa-a02f-eb569b918193 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:22.656626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:22.657251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.657592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.657873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.658549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:22.658856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:22.660310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:22.694799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 15/32] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:22.695659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:22.716749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:22.782723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87624de6-5dad-4eaa-a02f-eb569b918193 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:22.812268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:22.823689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c3ef2-38c0-47ef-bbc7-a638f42ab8cd None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:22.863762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:22.864695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.865492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.865926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.866735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:22.868384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:22.880607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:22.881291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:22.891603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:22.891603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:22.891603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:22.891603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:22.891603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:22.903688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 18/33] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:22.904365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:23.009703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc94c8-c6fd-4167-b686-9d2547032fd7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:23.044402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:23.045330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:23.046418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.046771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.047109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] PATH_INFO: `/v3/users/dde84621695a4b64985c2f72dbefe3be` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.048715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] RBAC: Authorizing `identity:get_user(user_id=dde84621695a4b64985c2f72dbefe3be)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:23.050252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:23.051931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 19/34] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:22 2022] GET /identity/v3/users/dde84621695a4b64985c2f72dbefe3be => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:23.052766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:23.131199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 16/35] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 25 04:52:22 2022] POST /identity/v3/roles => generated 225 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:23.132477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:23.160199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088bf00-6d90-4f9f-ae01-6283dcd7ab5f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:23.198755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e7e81-ac07-4bd2-8afc-f4c4d98de7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:23.199384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e7e81-ac07-4bd2-8afc-f4c4d98de7d2 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.199660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e7e81-ac07-4bd2-8afc-f4c4d98de7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.199947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e7e81-ac07-4bd2-8afc-f4c4d98de7d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.200614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e7e81-ac07-4bd2-8afc-f4c4d98de7d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:23.202380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e7e81-ac07-4bd2-8afc-f4c4d98de7d2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:23.252337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484ce19-e07c-4355-8975-e1a6b57ae8de None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:23.290758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:23.291491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.291773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.292178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.293758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:23.295370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:23.297142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 17/36] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:23.297984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:23.315079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:23.401844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95b03d-c41c-4e36-a2ee-eb050e1283cb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:23.432245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 20/37] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:52:23 2022] POST /identity/v3/projects => generated 301 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:23.433711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab9c6-8dab-4d25-a0f4-bff9d1304032 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.434001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab9c6-8dab-4d25-a0f4-bff9d1304032 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.434273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab9c6-8dab-4d25-a0f4-bff9d1304032 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.435522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 21/38] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:23.436629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7239d0c-21ae-4e7d-9ec6-14ed6d014734 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.436905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7239d0c-21ae-4e7d-9ec6-14ed6d014734 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.437184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7239d0c-21ae-4e7d-9ec6-14ed6d014734 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.442024 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 22/39] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:23.442024 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7239d0c-21ae-4e7d-9ec6-14ed6d014734 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:23.448989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae992a-55a9-4a83-828f-5e6102e722a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:23.450286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae992a-55a9-4a83-828f-5e6102e722a0 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.450573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae992a-55a9-4a83-828f-5e6102e722a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.450853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae992a-55a9-4a83-828f-5e6102e722a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.451554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae992a-55a9-4a83-828f-5e6102e722a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:23.453055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae992a-55a9-4a83-828f-5e6102e722a0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:23.503850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:23.534833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 18/40] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 25 04:52:23 2022] POST /identity/v3/roles => generated 219 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:23.536258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e6221-7e6b-4a14-86aa-b9273bb1a157 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.536546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e6221-7e6b-4a14-86aa-b9273bb1a157 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.536842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e6221-7e6b-4a14-86aa-b9273bb1a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.565404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-383e6221-7e6b-4a14-86aa-b9273bb1a157 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:23.568458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-383e6221-7e6b-4a14-86aa-b9273bb1a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:23.573312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7239d0c-21ae-4e7d-9ec6-14ed6d014734 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:23.620349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:23.620349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.620650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.620722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] PATH_INFO: `/v3/domains/default/users/dde84621695a4b64985c2f72dbefe3be/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.627727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dde84621695a4b64985c2f72dbefe3be, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:23.629504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:23.668232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 19/41] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:23.669486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1bd7-8c6b-471f-8f1a-41fd90465d69 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:23.669780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1bd7-8c6b-471f-8f1a-41fd90465d69 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:23.670062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be1bd7-8c6b-471f-8f1a-41fd90465d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:23.678702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:23.692574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-84be1bd7-8c6b-471f-8f1a-41fd90465d69 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:23.693850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-84be1bd7-8c6b-471f-8f1a-41fd90465d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:23.729044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 23/42] 10.222.0.45 () {58 vars in 1361 bytes} [Thu Aug 25 04:52:23 2022] PUT /identity/v3/domains/default/users/dde84621695a4b64985c2f72dbefe3be/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:23.781977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 20/43] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:23.947377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:24.053599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be1bd7-8c6b-471f-8f1a-41fd90465d69 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:24.075460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d2db3-5caf-4075-b0d1-91dd9c019172 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:24.085924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:24.112133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:24.112796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:24.113081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:24.113410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:24.114692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:24.116426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:24.120655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 24/44] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:24.125229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:24.237335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acf0a2-8dca-4ea2-9c0e-33db6e25df15 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:24.262796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be1bd7-8c6b-471f-8f1a-41fd90465d69 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:24.274520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20213c4e-ef4d-4824-ab89-80c3d9a316ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:24.275144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213c4e-ef4d-4824-ab89-80c3d9a316ee None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:24.275557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213c4e-ef4d-4824-ab89-80c3d9a316ee None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:24.275836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213c4e-ef4d-4824-ab89-80c3d9a316ee None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:24.276609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20213c4e-ef4d-4824-ab89-80c3d9a316ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:24.278184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20213c4e-ef4d-4824-ab89-80c3d9a316ee None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:24.297545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c438f41-ecb0-4aee-a80b-8e3fee5c4165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:24.298165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438f41-ecb0-4aee-a80b-8e3fee5c4165 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:24.298465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438f41-ecb0-4aee-a80b-8e3fee5c4165 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:24.298733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c438f41-ecb0-4aee-a80b-8e3fee5c4165 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:24.299402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c438f41-ecb0-4aee-a80b-8e3fee5c4165 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:24.300837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c438f41-ecb0-4aee-a80b-8e3fee5c4165 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:24.304147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:24.424682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 25/45] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:52:24 2022] POST /identity/v3/projects => generated 312 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:52:24.441809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 21/46] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 25 04:52:24 2022] POST /identity/v3/roles => generated 223 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:52:25.625170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f932-809d-4d2a-9948-f48ace31e6e6 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:25.625712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f932-809d-4d2a-9948-f48ace31e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:25.625712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f932-809d-4d2a-9948-f48ace31e6e6 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:25.627077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 26/47] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:25.632456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074356d9-f58f-4a25-98a8-452d5623a304 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:25.632838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074356d9-f58f-4a25-98a8-452d5623a304 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:25.633011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074356d9-f58f-4a25-98a8-452d5623a304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:25.651294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-074356d9-f58f-4a25-98a8-452d5623a304 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:25.652516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-074356d9-f58f-4a25-98a8-452d5623a304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:25.721693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 22/48] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:25.987073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573f932-809d-4d2a-9948-f48ace31e6e6 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:26.015380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:26.088716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573f932-809d-4d2a-9948-f48ace31e6e6 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:26.122589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:26.123214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.123495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.123774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.134138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:26.138842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:26.139686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:26.140490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 27/49] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:26.145876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074356d9-f58f-4a25-98a8-452d5623a304 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:26.242236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074356d9-f58f-4a25-98a8-452d5623a304 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:26.266240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:26.276498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524670a1-759c-47ad-a90d-d759fa1504ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:26.277117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524670a1-759c-47ad-a90d-d759fa1504ac None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.277397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524670a1-759c-47ad-a90d-d759fa1504ac None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.277667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524670a1-759c-47ad-a90d-d759fa1504ac None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.278332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524670a1-759c-47ad-a90d-d759fa1504ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:26.278661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524670a1-759c-47ad-a90d-d759fa1504ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:26.280081 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524670a1-759c-47ad-a90d-d759fa1504ac None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:26.288139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 23/50] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:26.294005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:26.353667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ed93-8a84-45f9-aad9-5c4176edcae8 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.353956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ed93-8a84-45f9-aad9-5c4176edcae8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.354234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35ed93-8a84-45f9-aad9-5c4176edcae8 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.355660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 24/51] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:26.361564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817386d-0330-4fd3-be89-6e2f65bbc773 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.361856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817386d-0330-4fd3-be89-6e2f65bbc773 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.362137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817386d-0330-4fd3-be89-6e2f65bbc773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.381864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a817386d-0330-4fd3-be89-6e2f65bbc773 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:26.383098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a817386d-0330-4fd3-be89-6e2f65bbc773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:26.455488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 25/52] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:26.487228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:26.499469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b6d32-7e9f-488f-a8fe-ae6a4f294971 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:26.531769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:26.532426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.532706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.532981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] PATH_INFO: `/v3/users/dde84621695a4b64985c2f72dbefe3be` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.534109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] RBAC: Authorizing `identity:get_user(user_id=dde84621695a4b64985c2f72dbefe3be)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:26.535575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:26.537185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 28/53] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:26 2022] GET /identity/v3/users/dde84621695a4b64985c2f72dbefe3be => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:26.543362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817386d-0330-4fd3-be89-6e2f65bbc773 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:26.640115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817386d-0330-4fd3-be89-6e2f65bbc773 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:26.655782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:26.673143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:26.673776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.675842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.675842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.675842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:26.676960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:26.678522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 26/54] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:26.685112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:26.722044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:26.786434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23660c-0699-4946-a2e8-0e20a0370403 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:26.819549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:26.820186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.820469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.820801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.821528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.domain.id=default, user.id=dde84621695a4b64985c2f72dbefe3be) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:26.821839 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:26.823017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a719be-566e-48ac-9224-d981a7d98f4f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:26.823298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:26.829024 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 29/55] 10.222.0.45 () {56 vars in 1322 bytes} [Thu Aug 25 04:52:26 2022] GET /identity/v3/role_assignments?user.id=dde84621695a4b64985c2f72dbefe3be&scope.domain.id=default&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:26.859139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a263c-fff7-47f4-8e2e-8fb0093800fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:26.859791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a263c-fff7-47f4-8e2e-8fb0093800fb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:26.860105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a263c-fff7-47f4-8e2e-8fb0093800fb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:26.860379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a263c-fff7-47f4-8e2e-8fb0093800fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:26.861563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a263c-fff7-47f4-8e2e-8fb0093800fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:26.863079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a263c-fff7-47f4-8e2e-8fb0093800fb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:26.864764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 27/56] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:26.870566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:26.895016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:26.978439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00000d9e-c574-437b-b756-2219d74c9111 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:27.013849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832140bc-8d57-4549-98e5-f91fd2d2fa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:27.014464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832140bc-8d57-4549-98e5-f91fd2d2fa82 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:27.014748 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832140bc-8d57-4549-98e5-f91fd2d2fa82 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:27.015021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832140bc-8d57-4549-98e5-f91fd2d2fa82 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:27.015681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832140bc-8d57-4549-98e5-f91fd2d2fa82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:27.017210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832140bc-8d57-4549-98e5-f91fd2d2fa82 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:27.117403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 30/57] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Aug 25 04:52:26 2022] POST /identity/v3/projects => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:29.116901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca42a-54e9-4ff4-b846-2b071bf036b1 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:29.117940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca42a-54e9-4ff4-b846-2b071bf036b1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:29.118032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ca42a-54e9-4ff4-b846-2b071bf036b1 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:29.119423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 28/58] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:29.124611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4c70-0da3-4f21-b065-e3cf9ca8fb29 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:29.124974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4c70-0da3-4f21-b065-e3cf9ca8fb29 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:29.125172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4c70-0da3-4f21-b065-e3cf9ca8fb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:29.143147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-0cfa4c70-0da3-4f21-b065-e3cf9ca8fb29 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:29.144711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0cfa4c70-0da3-4f21-b065-e3cf9ca8fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:29.223154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:29.510007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca42a-54e9-4ff4-b846-2b071bf036b1 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:29.570459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:29.616792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ca42a-54e9-4ff4-b846-2b071bf036b1 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:29.649737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b26d6a-9ab3-4309-80e4-ebf99789cd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:29.650359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26d6a-9ab3-4309-80e4-ebf99789cd1e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:29.650659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26d6a-9ab3-4309-80e4-ebf99789cd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:29.650916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b26d6a-9ab3-4309-80e4-ebf99789cd1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:29.652064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26d6a-9ab3-4309-80e4-ebf99789cd1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:29.653528 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b26d6a-9ab3-4309-80e4-ebf99789cd1e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:29.655099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 29/60] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:29.660666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa4c70-0da3-4f21-b065-e3cf9ca8fb29 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:29.662928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:29.759184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa4c70-0da3-4f21-b065-e3cf9ca8fb29 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:29.792910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239c42-bbe0-4f43-a885-462ba727d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:29.793457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239c42-bbe0-4f43-a885-462ba727d31a None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:29.793735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239c42-bbe0-4f43-a885-462ba727d31a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:29.794008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239c42-bbe0-4f43-a885-462ba727d31a None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:29.794656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239c42-bbe0-4f43-a885-462ba727d31a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:29.796140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239c42-bbe0-4f43-a885-462ba727d31a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:29.903556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 32/61] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:52:29 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:52:32.970921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e2a4-c1ea-41f8-bad2-83a7f0451cd9 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:32.971951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e2a4-c1ea-41f8-bad2-83a7f0451cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:32.972445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e2a4-c1ea-41f8-bad2-83a7f0451cd9 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:32.974569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 30/62] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:32.985670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11de588-aab4-4ba8-9709-219e7db903d8 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:32.986560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11de588-aab4-4ba8-9709-219e7db903d8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:32.987041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11de588-aab4-4ba8-9709-219e7db903d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.012973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a11de588-aab4-4ba8-9709-219e7db903d8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:33.014533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a11de588-aab4-4ba8-9709-219e7db903d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:33.088013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:33.110263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 33/63] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:33.155541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68613976-c97f-4437-8625-d974b12ca60b None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.156167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68613976-c97f-4437-8625-d974b12ca60b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.156648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68613976-c97f-4437-8625-d974b12ca60b None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.158201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 31/64] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:33.163621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cce271-262a-47c7-80ce-42cb74760da1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.164745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cce271-262a-47c7-80ce-42cb74760da1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.165412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cce271-262a-47c7-80ce-42cb74760da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.190378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-90cce271-262a-47c7-80ce-42cb74760da1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:33.191614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-90cce271-262a-47c7-80ce-42cb74760da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:33.282229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 34/65] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:33.328956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468052d-4024-4647-944f-95ce3966b325 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.329590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468052d-4024-4647-944f-95ce3966b325 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.330099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468052d-4024-4647-944f-95ce3966b325 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.331683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 32/66] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:33.337380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22c5f-3a3f-4d4c-a4c2-a39f0bd51a62 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.337679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22c5f-3a3f-4d4c-a4c2-a39f0bd51a62 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.337951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22c5f-3a3f-4d4c-a4c2-a39f0bd51a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.356279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f9b5-d740-474a-a36a-bc9b228b5e0c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.356902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f9b5-d740-474a-a36a-bc9b228b5e0c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.357387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f9b5-d740-474a-a36a-bc9b228b5e0c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.358992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 33/67] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:33.362061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d9c22c5f-3a3f-4d4c-a4c2-a39f0bd51a62 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:33.363269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d9c22c5f-3a3f-4d4c-a4c2-a39f0bd51a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:33.364531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f8dc3-fce2-44a4-9ea9-a3388f88c246 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.365042 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f8dc3-fce2-44a4-9ea9-a3388f88c246 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.365521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f8dc3-fce2-44a4-9ea9-a3388f88c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.400608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-171f8dc3-fce2-44a4-9ea9-a3388f88c246 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:33.402184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-171f8dc3-fce2-44a4-9ea9-a3388f88c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:33.452838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 35/68] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:33.503357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27224187-ea00-4412-9d61-1d0d3d9d7af5 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.503867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27224187-ea00-4412-9d61-1d0d3d9d7af5 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.504365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27224187-ea00-4412-9d61-1d0d3d9d7af5 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.505887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 36/69] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:33.512050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef695932-a2cf-42f0-ba10-78115b543267 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.512525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef695932-a2cf-42f0-ba10-78115b543267 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.512952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef695932-a2cf-42f0-ba10-78115b543267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.524035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 34/70] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:33.525331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f8dc3-fce2-44a4-9ea9-a3388f88c246 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:33.541812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ef695932-a2cf-42f0-ba10-78115b543267 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:33.542969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ef695932-a2cf-42f0-ba10-78115b543267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:33.604258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:33.620314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:33.646238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 37/71] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:33.647463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef695932-a2cf-42f0-ba10-78115b543267 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:33.714730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f8dc3-fce2-44a4-9ea9-a3388f88c246 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:33.766809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:33.767681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.768174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.768596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.769926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef695932-a2cf-42f0-ba10-78115b543267 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:33.780320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:33.785714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:33.786694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:33.787671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:33.789782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 35/72] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:33.790792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:33.812057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:33.812868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.813255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.813632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.825149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:33.830354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:33.831249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:33.832067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 38/73] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:33.832708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:33.881859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:33.912672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec3b2-67a7-4ee7-8049-5ce8a21d6732 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:33.924644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:33.948942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:33.949572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.949868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.950126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.951011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b308a1e-52b6-4ad5-b0a8-9cb723002b7e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:33.960071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:33.965634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:33.966402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 36/74] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:52:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:33.967048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:33.993274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:33.993895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:33.994181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:33.994458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:33.995130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:33.995441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:33.996959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.005054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 39/75] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.005855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.074514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49433b81-43ef-43c2-8564-831e2258b76d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.104134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.106950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a73e8f-b289-4df7-b747-e4c446adad03 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.109275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.109884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.110189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.110454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.111127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:34.111438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.112874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.121257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 37/76] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.122062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.142340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.142979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.143262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.143532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.144675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.146128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.147699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 40/77] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.148528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.156317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.238202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc40a4-6005-4ff9-9b1b-6b38695f7d00 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.260158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73893c3-27e2-4ca9-9da8-5cb1ac8ad07c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.271797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.272357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.272633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.272902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.274313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:34.274573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.275992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.283691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 38/78] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.285669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.296388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.297032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.297325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.297591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.307634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:34.312383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:34.313340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:34.314147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 41/79] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:34.318892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.347271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.377073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.383886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a8271-8571-4fbe-a1b9-b81bfb645671 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.417330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.417960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.418247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.418452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7e904-c659-45df-a541-9978a52a779e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.418543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.432051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.433518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.435161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 39/80] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.435965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.453529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.454157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.454441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.454714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] PATH_INFO: `/v3/users/dde84621695a4b64985c2f72dbefe3be` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.455835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] RBAC: Authorizing `identity:get_user(user_id=dde84621695a4b64985c2f72dbefe3be)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.457314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.458886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 42/81] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/users/dde84621695a4b64985c2f72dbefe3be => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.459645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.544205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219792f-fc3d-4313-b19c-92f13f580677 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.553878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.559556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fbc0b-62d2-4f2a-b2b5-7d0fabd16d1f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.577762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.578375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.578659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.578939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.579591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.581110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.593238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.594127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.594464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.594935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.596424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.597912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.599717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 43/82] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.600488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.662716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 40/83] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:52:34 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:34.663602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.675398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.714470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c7fc3-6abd-4b9b-a603-5f0d3b5a5ab2 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.753735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.754882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.754882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.755048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.755602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:34.755929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.757502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.775146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 44/84] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:34.775146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:34.786827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd867e6-3f0b-4a79-8ab0-908d01659101 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.810260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.828966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.829504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.829829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.830733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:34.904166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fe9ae-7656-4d43-a44e-255b7a610db3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:34.915759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:34.917472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:34.934654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:34.954690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:34.955362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:34.955647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:34.955946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.040305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 41/85] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:35.041185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.049401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.050891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.078699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:35.165480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 45/86] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:35.165697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.185010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58bf9f-bcca-44fd-9f3d-f4604ee64c5a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.197279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:35.234987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:35.236617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:35.237099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:35.237765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.286471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3682cb-c6a8-47b4-87b2-5c61809f0bc5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.313807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:35.321742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.323228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.323775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:35.324620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:35.325042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:35.325456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.326842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.328560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.330334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 46/87] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:35.331299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.439039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513724d0-95dd-4750-8f28-53b599e16925 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.439517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 42/88] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:35.444702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.456165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:35.477841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:35.478695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:35.479118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:35.479532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.481200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.482646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.484457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 47/89] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:35.485429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.552646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:35.562903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576aa11-7810-471c-862f-7bf9eca68960 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.597471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8960d-2c6e-4e40-89d3-5b263553c4dc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.599505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:35.600164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:35.600450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:35.601375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.602521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.604071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.605898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 43/90] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:35.606474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.636396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:35.637349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:35.637850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:35.638294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.691378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:35.715998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393948c-36db-4bff-992e-8bb31de2679a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.720243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.721960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.754495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:35.755337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:35.755556 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:35.755836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.757195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.759415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.761513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 44/91] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:35.762094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.796852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:35.841109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 48/92] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:35.846676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.876389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e852a-e620-4a0b-8635-5ba3afbfba3d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.916101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:35.916734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:35.917165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:35.917563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:35.918311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=d4028913228d4e89aa295f4b699c2726) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:35.918863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:35.920818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:35.931237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 45/93] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/role_assignments?user.id=d4028913228d4e89aa295f4b699c2726&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=e305aaac48e64ec7ae700613e1672700 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:35.932772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:35.955595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ac6b-63b8-4924-9649-729615da560d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:35.992830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:36.001438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:36.002051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:36.002331 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:36.002603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:36.003337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=dde84621695a4b64985c2f72dbefe3be) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:36.003644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:36.005136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:36.011357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 49/94] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/role_assignments?user.id=dde84621695a4b64985c2f72dbefe3be&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:36.012002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:36.047181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:36.067337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26198372-2ed0-4c38-b08d-809dc24a3ec2 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:36.110071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:36.110899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:36.111189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:36.111510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:36.112306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] RBAC: Adding query filter params (role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=d4028913228d4e89aa295f4b699c2726) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:36.112608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:36.114309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:36.122001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 46/95] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:35 2022] GET /identity/v3/role_assignments?user.id=d4028913228d4e89aa295f4b699c2726&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:36.209836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da36c9-d792-4701-9eff-8153e6d136fb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:36.254593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a7996-1c1c-4001-8bc9-9e68ef7e3e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:36.255656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a7996-1c1c-4001-8bc9-9e68ef7e3e31 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:36.256163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a7996-1c1c-4001-8bc9-9e68ef7e3e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:36.256637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a7996-1c1c-4001-8bc9-9e68ef7e3e31 None admin] PATH_INFO: `/v3/projects/c7d67756f4974e5082afa5b9da96ddd0` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:36.260702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a7996-1c1c-4001-8bc9-9e68ef7e3e31 None admin] RBAC: Authorizing `identity:get_project(project_id=c7d67756f4974e5082afa5b9da96ddd0)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:36.262488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a7996-1c1c-4001-8bc9-9e68ef7e3e31 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:36.264479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 50/96] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:36 2022] GET /identity/v3/projects/c7d67756f4974e5082afa5b9da96ddd0 => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:36.270772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:36.380290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:36.412165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ef6b-4147-4fdf-b544-93e7f77a2d9a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:36.456631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667bbea-77f8-4f8d-9439-b142526fdf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:36.457307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bbea-77f8-4f8d-9439-b142526fdf32 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:36.457600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bbea-77f8-4f8d-9439-b142526fdf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:36.457872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667bbea-77f8-4f8d-9439-b142526fdf32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:36.458612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bbea-77f8-4f8d-9439-b142526fdf32 None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=c7d67756f4974e5082afa5b9da96ddd0, user.id=d4028913228d4e89aa295f4b699c2726) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:36.458920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bbea-77f8-4f8d-9439-b142526fdf32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:36.460470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667bbea-77f8-4f8d-9439-b142526fdf32 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:36.467117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 47/97] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:36 2022] GET /identity/v3/role_assignments?user.id=d4028913228d4e89aa295f4b699c2726&scope.project.id=c7d67756f4974e5082afa5b9da96ddd0&role.id=e305aaac48e64ec7ae700613e1672700 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:36.965454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46ee5-9291-40f5-9e0b-870a173b3dd7 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:36.965821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46ee5-9291-40f5-9e0b-870a173b3dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:36.966020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46ee5-9291-40f5-9e0b-870a173b3dd7 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:36.967395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 51/98] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:36.972864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99356d28-9997-4b7d-8805-3c56683ca6da None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:36.973156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99356d28-9997-4b7d-8805-3c56683ca6da None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:36.973438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99356d28-9997-4b7d-8805-3c56683ca6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:37.001071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-99356d28-9997-4b7d-8805-3c56683ca6da None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:37.002284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-99356d28-9997-4b7d-8805-3c56683ca6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:37.078087 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 48/99] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:37.105833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2ce2f-451e-4bd9-af6d-a21f8283b678 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:37.106116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2ce2f-451e-4bd9-af6d-a21f8283b678 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:37.106396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2ce2f-451e-4bd9-af6d-a21f8283b678 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:37.107761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 52/100] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:37.113335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02551-0b27-43b7-a366-ef037e73af05 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:37.113623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02551-0b27-43b7-a366-ef037e73af05 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:37.113901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02551-0b27-43b7-a366-ef037e73af05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:37.138141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-06f02551-0b27-43b7-a366-ef037e73af05 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:37.139338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-06f02551-0b27-43b7-a366-ef037e73af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:37.201810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:37.209497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 49/101] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:37.510793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2ce2f-451e-4bd9-af6d-a21f8283b678 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:37.634584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:37.648741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2ce2f-451e-4bd9-af6d-a21f8283b678 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:37.692818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:37.693457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:37.693736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:37.694005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:37.708996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:37.716714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:37.717602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:37.718369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 53/102] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:37.725446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02551-0b27-43b7-a366-ef037e73af05 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:37.751959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:37.918619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02551-0b27-43b7-a366-ef037e73af05 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:37.938112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e0ddf-d821-4602-a838-120eb9190dc7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:37.986975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:37.988705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:37.989823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:37.990460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:37.993006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:37.994224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:37.996500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:38.008587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:38.010518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:38.011186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:38.012478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:38.015073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:38.016867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:38.017361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 50/103] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:38.020231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:38.027985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 54/104] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:38.029726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:38.072834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:38.136271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:38.208990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9446-2710-4fe8-a424-cb8e2ded191a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:38.224301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85046593-ae67-4455-9da3-43ac72388ae0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:38.250700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:38.251576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:38.252316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:38.252770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:38.253661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:38.255628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:38.292609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:38.293499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:38.293989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:38.294444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] PATH_INFO: `/v3/users/37bbe5736d55415f8d8e328174eb1a70` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:38.309066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] RBAC: Authorizing `identity:get_user(user_id=37bbe5736d55415f8d8e328174eb1a70)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:38.310819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:38.312685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 51/105] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:38 2022] GET /identity/v3/users/37bbe5736d55415f8d8e328174eb1a70 => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:38.318092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:38.350844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 55/106] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:52:38 2022] POST /identity/v3/projects => generated 302 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:52:38.438819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669e092-7aee-4d4b-9316-99f0712840b3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:38.485428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:38.512055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475ffde-0b14-42a9-985b-a10b73b6efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:38.512690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ffde-0b14-42a9-985b-a10b73b6efc9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:38.512977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ffde-0b14-42a9-985b-a10b73b6efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:38.513255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ffde-0b14-42a9-985b-a10b73b6efc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:38.588408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475ffde-0b14-42a9-985b-a10b73b6efc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:38.589951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475ffde-0b14-42a9-985b-a10b73b6efc9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:38.712862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 52/107] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 04:52:38.718518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:38.831698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:38.863716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda797c-d975-4f41-b4bb-a668a8e3ea5d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:38.868945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44f702-f46a-4c40-87a5-87034977b9f9 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:38.869739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44f702-f46a-4c40-87a5-87034977b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:38.870188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44f702-f46a-4c40-87a5-87034977b9f9 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:38.871706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 53/108] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:38.896832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b83-c396-44f4-ae10-4056957742c5 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:38.897341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b83-c396-44f4-ae10-4056957742c5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:38.897817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b83-c396-44f4-ae10-4056957742c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:38.905965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:38.906720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:38.907014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:38.907295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:38.908599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:38.910131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:38.912491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 56/109] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:38 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:38.919407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:38.932902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f72b2b83-c396-44f4-ae10-4056957742c5 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:38.934322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f72b2b83-c396-44f4-ae10-4056957742c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:38.949433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:39.047197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 54/110] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:39.070931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596682d-5cb6-4b02-95b1-5abf1d9538b6 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.071535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596682d-5cb6-4b02-95b1-5abf1d9538b6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.072034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596682d-5cb6-4b02-95b1-5abf1d9538b6 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.073606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 55/111] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:39.079573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59031daf-bbad-49d8-b0ae-400cd4410237 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.080125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59031daf-bbad-49d8-b0ae-400cd4410237 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.080600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59031daf-bbad-49d8-b0ae-400cd4410237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.105941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dc02-1883-4b80-80e4-d9f664a8d153 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:39.108696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-59031daf-bbad-49d8-b0ae-400cd4410237 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:39.111125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-59031daf-bbad-49d8-b0ae-400cd4410237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:39.169966 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ba286-44f0-4a6f-b9e6-065fcf36cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:39.170946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba286-44f0-4a6f-b9e6-065fcf36cc8e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.171425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba286-44f0-4a6f-b9e6-065fcf36cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.171898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ba286-44f0-4a6f-b9e6-065fcf36cc8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.172874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba286-44f0-4a6f-b9e6-065fcf36cc8e None admin] RBAC: Adding query filter params (role.id=45c36965457d4c4e93c0f7bc2b98fad9, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=37bbe5736d55415f8d8e328174eb1a70) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:39.173402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba286-44f0-4a6f-b9e6-065fcf36cc8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:39.175577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ba286-44f0-4a6f-b9e6-065fcf36cc8e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:39.189574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 57/112] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:38 2022] GET /identity/v3/role_assignments?user.id=37bbe5736d55415f8d8e328174eb1a70&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=45c36965457d4c4e93c0f7bc2b98fad9 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:39.218673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 56/113] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:39.303466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fb5b6-5144-4580-b017-300117c7c837 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fb5b6-5144-4580-b017-300117c7c837 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.304736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fb5b6-5144-4580-b017-300117c7c837 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.306925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 58/114] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:39.312122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c2328-1514-4d6b-8d16-71d41e2e907b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.312694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c2328-1514-4d6b-8d16-71d41e2e907b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.313193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c2328-1514-4d6b-8d16-71d41e2e907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.337099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c75c2328-1514-4d6b-8d16-71d41e2e907b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:39.338803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c75c2328-1514-4d6b-8d16-71d41e2e907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:39.436972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 57/115] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:39.542195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fb5b6-5144-4580-b017-300117c7c837 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:39.552221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:39.570396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c2328-1514-4d6b-8d16-71d41e2e907b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:39.583290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:39.760374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fb5b6-5144-4580-b017-300117c7c837 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:39.776133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c2328-1514-4d6b-8d16-71d41e2e907b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:39.821361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62ad1f-cbbd-4321-bcfd-4d2001c5ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:39.822246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62ad1f-cbbd-4321-bcfd-4d2001c5ad24 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.822667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62ad1f-cbbd-4321-bcfd-4d2001c5ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.823699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62ad1f-cbbd-4321-bcfd-4d2001c5ad24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.837198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:39.838763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.839060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.839348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.841947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62ad1f-cbbd-4321-bcfd-4d2001c5ad24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-3f62ad1f-cbbd-4321-bcfd-4d2001c5ad24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:39.848232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:39.849378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:39.850158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:39.850753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:39.852762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 59/116] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:39.855636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:39.856772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:39.857738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:39.858896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debfda-707a-46ea-86b6-5d4d205d09ae None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:39.859203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debfda-707a-46ea-86b6-5d4d205d09ae None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:39.859491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6debfda-707a-46ea-86b6-5d4d205d09ae None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:39.860282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 58/117] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:52:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:39.864669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 60/118] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:39.864669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6debfda-707a-46ea-86b6-5d4d205d09ae None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:39.864851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:39.958919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:39.965082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:40.005677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120f42e-42ac-4f5e-9282-9229ea6ce9d3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.016903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6debfda-707a-46ea-86b6-5d4d205d09ae None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.045641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.046517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.046940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.047399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.061733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bc1a1-341a-493c-8635-edbf6c6de8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.062137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:40.062615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bc1a1-341a-493c-8635-edbf6c6de8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.063113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bc1a1-341a-493c-8635-edbf6c6de8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.063583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bc1a1-341a-493c-8635-edbf6c6de8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.064502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bc1a1-341a-493c-8635-edbf6c6de8a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:40.065007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bc1a1-341a-493c-8635-edbf6c6de8a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.066685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bc1a1-341a-493c-8635-edbf6c6de8a1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:40.067176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:40.068157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:40.068920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 59/119] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:40.069558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.080456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 61/120] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.082019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805bf80-e132-4342-a783-362b64d9bbbc None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.082499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805bf80-e132-4342-a783-362b64d9bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.083020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805bf80-e132-4342-a783-362b64d9bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.103365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e805bf80-e132-4342-a783-362b64d9bbbc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:40.104921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e805bf80-e132-4342-a783-362b64d9bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:40.179260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 62/121] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:40.180826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805bf80-e132-4342-a783-362b64d9bbbc None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.211296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cedb31-8a6d-4748-9421-b6472cae7d91 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.242349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:40.248870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:40.263940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.263940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.263940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.263940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.264428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:40.264428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.264428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.272621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 60/122] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.274087 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.313755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805bf80-e132-4342-a783-362b64d9bbbc None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.385571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.386545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.387026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.387521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.388494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:40.389054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.390671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.399977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b515f1d-3741-4af5-9190-dbc530a9f7ad None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.412213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 63/123] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.413329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.436325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.437446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.437737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.438020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.439304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.441120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.443071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 61/124] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.448333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.549884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:40.568474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c00f5e-cddd-4454-bdcd-06e116bf4811 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.596547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:40.598419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1f06-6ba9-46ea-bfc0-ff2640c916a8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.614909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.616058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.616514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.617698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.619276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.620941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.623848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 64/125] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.625083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.637695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.638501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.638924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.639299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.640816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.642621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.644561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 62/126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.649592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.761713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021bdee-6cf0-4861-b988-fb77c3e5ff10 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.768143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db591a-ac76-43b7-bfc8-d73e5a9edd49 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.785995 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:40.798133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.798887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.801056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.801056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.805804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.806627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.807052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.807505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.808944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.810641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.812431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:40.813294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 65/127] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.814284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:40.818692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:40.819791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:40.821255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:40.822396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 63/128] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:40.828149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.887950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:40.933854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed8f56-5913-4281-82d0-ab4f8f047206 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.938409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea869-f3af-4e90-84b4-abd439d0e70c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:40.971291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.971960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.972247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.972523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] PATH_INFO: `/v3/projects/c7d67756f4974e5082afa5b9da96ddd0` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.974004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] RBAC: Authorizing `identity:get_project(project_id=c7d67756f4974e5082afa5b9da96ddd0)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.975805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.978378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:40.983356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 64/129] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/projects/c7d67756f4974e5082afa5b9da96ddd0 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.983356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:40.984352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:40.984850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:40.985328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:40.987102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:40.988830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:40.990792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 66/130] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:40.992147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:41.037712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:41.090155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3deaf-5dc9-462f-96b7-4dd4df01886c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:41.107403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfff430-5815-4a0e-a2b1-1c9a150a6536 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:41.128626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:41.129710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.129994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.130545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/d4028913228d4e89aa295f4b699c2726/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.132866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:41.133980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] RBAC: Authorizing `identity:create_grant(project_id=83c883f6c4b74c0281aa45208ab7de42, user_id=d4028913228d4e89aa295f4b699c2726, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:41.135351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:41.144166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:41.144854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.145140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.145421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.146088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:41.146397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:41.147772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:41.156914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 67/131] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:41.158750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:41.231285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 65/132] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:40 2022] PUT /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/d4028913228d4e89aa295f4b699c2726/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:41.232610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:41.272982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83187d18-cda9-4b9c-a773-e9f2a4182b98 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:41.314210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c623c-ce9a-423b-a417-394796c5df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:41.314914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c623c-ce9a-423b-a417-394796c5df44 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.315197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c623c-ce9a-423b-a417-394796c5df44 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.315481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c623c-ce9a-423b-a417-394796c5df44 None admin] PATH_INFO: `/v3/projects/c7d67756f4974e5082afa5b9da96ddd0/users/d4028913228d4e89aa295f4b699c2726/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.317953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c623c-ce9a-423b-a417-394796c5df44 None admin] RBAC: Authorizing `identity:create_grant(project_id=c7d67756f4974e5082afa5b9da96ddd0, user_id=d4028913228d4e89aa295f4b699c2726, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:41.319575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c623c-ce9a-423b-a417-394796c5df44 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:41.375899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f771105-3ca5-47b3-a3d2-99d61e26964f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:41.391841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:41.418845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bc314-106e-4ce7-a0ad-642ba059d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:41.419576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bc314-106e-4ce7-a0ad-642ba059d7c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.419867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bc314-106e-4ce7-a0ad-642ba059d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.420182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bc314-106e-4ce7-a0ad-642ba059d7c4 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/d4028913228d4e89aa295f4b699c2726/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.423041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bc314-106e-4ce7-a0ad-642ba059d7c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c883f6c4b74c0281aa45208ab7de42, user_id=d4028913228d4e89aa295f4b699c2726, role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:41.424619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bc314-106e-4ce7-a0ad-642ba059d7c4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:41.426434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 68/133] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:41 2022] PUT /identity/v3/projects/c7d67756f4974e5082afa5b9da96ddd0/users/d4028913228d4e89aa295f4b699c2726/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:41.429083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158bdd-f769-4868-9b6d-6e884f7a1c41 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.429833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158bdd-f769-4868-9b6d-6e884f7a1c41 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.430184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158bdd-f769-4868-9b6d-6e884f7a1c41 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.432016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 69/134] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:41.436008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08158bdd-f769-4868-9b6d-6e884f7a1c41 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:41.495303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:41.512314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 66/135] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:41 2022] PUT /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/d4028913228d4e89aa295f4b699c2726/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:41.514848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50348a-ed1f-4a13-aee4-ced4b7464a2c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.517028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50348a-ed1f-4a13-aee4-ced4b7464a2c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.518089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50348a-ed1f-4a13-aee4-ced4b7464a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.543304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0f50348a-ed1f-4a13-aee4-ced4b7464a2c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:41.545907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0f50348a-ed1f-4a13-aee4-ced4b7464a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:41.592202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08158bdd-f769-4868-9b6d-6e884f7a1c41 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:41.660265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf09f1-40eb-4ca3-9609-513f1c053d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:41.660854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf09f1-40eb-4ca3-9609-513f1c053d3f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.661141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf09f1-40eb-4ca3-9609-513f1c053d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.661422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf09f1-40eb-4ca3-9609-513f1c053d3f None admin] PATH_INFO: `/v3/users/dde84621695a4b64985c2f72dbefe3be` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.662972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf09f1-40eb-4ca3-9609-513f1c053d3f None admin] RBAC: Authorizing `identity:get_user(user_id=dde84621695a4b64985c2f72dbefe3be)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:41.665790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf09f1-40eb-4ca3-9609-513f1c053d3f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:41.668196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 70/136] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:41 2022] GET /identity/v3/users/dde84621695a4b64985c2f72dbefe3be => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:41.669781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dfb0-42d8-405a-9e61-8e846c6d1ebf None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.670071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dfb0-42d8-405a-9e61-8e846c6d1ebf None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.670360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43dfb0-42d8-405a-9e61-8e846c6d1ebf None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.671878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 71/137] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:41.677331 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609fd7-2c7f-46ba-9599-14cbd464c1a8 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.678826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609fd7-2c7f-46ba-9599-14cbd464c1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.679600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609fd7-2c7f-46ba-9599-14cbd464c1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.695622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 67/138] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:41.697213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50348a-ed1f-4a13-aee4-ced4b7464a2c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:41.704204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-4d609fd7-2c7f-46ba-9599-14cbd464c1a8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:41.705882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4d609fd7-2c7f-46ba-9599-14cbd464c1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:41.784917 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 72/139] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:41.813088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50348a-ed1f-4a13-aee4-ced4b7464a2c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:41.814643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:41.854040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:41.855105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:41.855955 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:41.856526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:41.857704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:41.859186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:41.860887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 68/140] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:41 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:41.866737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609fd7-2c7f-46ba-9599-14cbd464c1a8 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:41.921443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:41.989144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609fd7-2c7f-46ba-9599-14cbd464c1a8 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:42.034397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:42.035304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:42.035732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:42.036208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/dde84621695a4b64985c2f72dbefe3be/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:42.038296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c883f6c4b74c0281aa45208ab7de42, user_id=dde84621695a4b64985c2f72dbefe3be, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:42.040902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:42.077848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:42.128700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 73/141] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:41 2022] PUT /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/dde84621695a4b64985c2f72dbefe3be/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:42.194756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4935d4-4880-43a7-af83-337bbed95a6d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:42.243627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:42.244746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:42.245259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:42.245732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:42.247168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:42.249024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:42.251257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 69/142] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:42.257125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:42.338819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:42.402428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:42.421338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835c8b-aade-458f-9402-bc0d06d5c859 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:42.435881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:42.487827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:42.488475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:42.488752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:42.489023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:42.489684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:42.491212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:42.512447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786d43-859c-4e54-aece-da785dca8529 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:42.550583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:42.551278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:42.551566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:42.551846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:42.568466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:42.573687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:42.574770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:42.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 70/143] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:52:42.582363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:42.603176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 74/144] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:52:42 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:42.733460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:42.737956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bba4d-8ed8-4979-9256-c0b55c86b7db None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:42.784876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:42.785783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:42.786220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:42.786653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:42.787495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:42.787978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:42.789648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:42.804926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 71/145] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:42.810883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:42.999932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b409dbe-bae3-4e58-9705-53db2902f54e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:43.043621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:43.044290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:43.044569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:43.044844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] PATH_INFO: `/v3/users/37bbe5736d55415f8d8e328174eb1a70` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:43.047124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] RBAC: Authorizing `identity:get_user(user_id=37bbe5736d55415f8d8e328174eb1a70)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:43.048740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:43.050636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 75/146] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:42 2022] GET /identity/v3/users/37bbe5736d55415f8d8e328174eb1a70 => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:43.056790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:43.202516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae5177-b51e-43b8-b869-3bf2fba45e18 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:43.246735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4507a6-8e96-4af6-9212-5ff67eaf2b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:43.247628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4507a6-8e96-4af6-9212-5ff67eaf2b81 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:43.248079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4507a6-8e96-4af6-9212-5ff67eaf2b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:43.248497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4507a6-8e96-4af6-9212-5ff67eaf2b81 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:43.252619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4507a6-8e96-4af6-9212-5ff67eaf2b81 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:43.254234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4507a6-8e96-4af6-9212-5ff67eaf2b81 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:43.256371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 72/147] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:43 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:43.262033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:43.334121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:43.424980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4c83-8d0a-440c-986f-cbe7724b2f83 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:43.467528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995741d-e878-498a-a22e-59abfe2e2b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:43.468247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995741d-e878-498a-a22e-59abfe2e2b62 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:43.468529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995741d-e878-498a-a22e-59abfe2e2b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:43.468808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995741d-e878-498a-a22e-59abfe2e2b62 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/37bbe5736d55415f8d8e328174eb1a70/roles/45c36965457d4c4e93c0f7bc2b98fad9` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:43.470972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995741d-e878-498a-a22e-59abfe2e2b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c883f6c4b74c0281aa45208ab7de42, user_id=37bbe5736d55415f8d8e328174eb1a70, role_id=45c36965457d4c4e93c0f7bc2b98fad9)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:43.472504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995741d-e878-498a-a22e-59abfe2e2b62 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:43.547080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 76/148] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:43 2022] PUT /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42/users/37bbe5736d55415f8d8e328174eb1a70/roles/45c36965457d4c4e93c0f7bc2b98fad9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:43.950499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371c5cf-480c-404f-b864-d824ec029270 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:43.951226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371c5cf-480c-404f-b864-d824ec029270 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:43.951727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371c5cf-480c-404f-b864-d824ec029270 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:43.953346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 73/149] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:43.958871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2a85b-9c1b-49c9-b980-7017e1ffe489 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:43.959322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2a85b-9c1b-49c9-b980-7017e1ffe489 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:43.959410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2a85b-9c1b-49c9-b980-7017e1ffe489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:43.988968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f7b2a85b-9c1b-49c9-b980-7017e1ffe489 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:43.990266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f7b2a85b-9c1b-49c9-b980-7017e1ffe489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:44.077969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 77/150] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:44.286222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d764a5-3bad-428d-88fc-dc5ab34bace0 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:44.287185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d764a5-3bad-428d-88fc-dc5ab34bace0 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:44.287669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d764a5-3bad-428d-88fc-dc5ab34bace0 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:44.289857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 74/151] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:44.296096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97823d0b-f506-4cdb-8702-72a5ca070b2d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:44.296388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97823d0b-f506-4cdb-8702-72a5ca070b2d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:44.296663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97823d0b-f506-4cdb-8702-72a5ca070b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:44.320926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-97823d0b-f506-4cdb-8702-72a5ca070b2d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:44.322128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-97823d0b-f506-4cdb-8702-72a5ca070b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:44.337049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:44.412712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 78/152] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:44.413579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d764a5-3bad-428d-88fc-dc5ab34bace0 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:44.451698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:44.542662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d764a5-3bad-428d-88fc-dc5ab34bace0 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:44.582653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:44.583294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:44.583575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:44.583850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:44.595501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:44.600704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:44.602278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:44.603521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 75/153] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:52:44.608454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97823d0b-f506-4cdb-8702-72a5ca070b2d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:44.722376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97823d0b-f506-4cdb-8702-72a5ca070b2d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:44.765574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:44.766192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:44.766470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:44.766743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:44.767412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:44.767715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:44.769147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:44.778804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 79/154] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:44.784398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:44.892971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:44.911848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e9a5-9343-41c4-a8d7-e5d21a1afdbb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:44.957148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cc43f-97a9-4293-bf30-12fef9e2d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:44.957795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cc43f-97a9-4293-bf30-12fef9e2d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:44.958076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cc43f-97a9-4293-bf30-12fef9e2d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:44.958348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cc43f-97a9-4293-bf30-12fef9e2d9b0 None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:44.959518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cc43f-97a9-4293-bf30-12fef9e2d9b0 None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:44.961741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cc43f-97a9-4293-bf30-12fef9e2d9b0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:44.963740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 76/155] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:44 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:44.969084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:44.986989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:45.015038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfafafb-8b96-44b5-8fcb-a0e51d73ecd6 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.015355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfafafb-8b96-44b5-8fcb-a0e51d73ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.015595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfafafb-8b96-44b5-8fcb-a0e51d73ecd6 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.017182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 77/156] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:45.029550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b81e14-5c4d-48ef-9771-74064d63a433 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.029858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b81e14-5c4d-48ef-9771-74064d63a433 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.030098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b81e14-5c4d-48ef-9771-74064d63a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.068392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-59b81e14-5c4d-48ef-9771-74064d63a433 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:45.070608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-59b81e14-5c4d-48ef-9771-74064d63a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:45.121699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e945cd8-0bb8-4eba-9a6a-c650915aa661 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:45.196422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:45.197658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.198160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.198638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.222340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 78/157] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:45.223606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07e3a-4192-4cc3-9d70-f3cf92879bc6 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.224179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07e3a-4192-4cc3-9d70-f3cf92879bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.224453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c07e3a-4192-4cc3-9d70-f3cf92879bc6 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.226813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 79/158] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:45.233033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e184e-4559-446e-8eef-5eebd3ade7d4 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.233314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e184e-4559-446e-8eef-5eebd3ade7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.233592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e184e-4559-446e-8eef-5eebd3ade7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.256059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2b1e184e-4559-446e-8eef-5eebd3ade7d4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:45.258058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2b1e184e-4559-446e-8eef-5eebd3ade7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:45.337008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:45.339143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:45.358588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:45.377390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 80/159] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:45.379148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e184e-4559-446e-8eef-5eebd3ade7d4 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:45.418225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:45.567360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e184e-4559-446e-8eef-5eebd3ade7d4 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:45.587511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 80/160] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:45.593041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:45.606357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:45.607270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.607709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.608176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.620157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:45.625492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:45.626592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:45.627632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:45.629598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 81/161] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:45.635791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:45.770698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecbc21-50ca-412e-95b2-3048a0336664 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:45.800842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:45.802771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:45.826201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:45.826559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.826837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.827102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] PATH_INFO: `/v3/projects/c7d67756f4974e5082afa5b9da96ddd0` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.832578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] RBAC: Authorizing `identity:get_project(project_id=c7d67756f4974e5082afa5b9da96ddd0)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:45.834221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:45.836728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 81/162] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:45 2022] GET /identity/v3/projects/c7d67756f4974e5082afa5b9da96ddd0 => generated 312 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:45.842766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:45.859041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d090c40-5070-45f2-bb88-4970814b035f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:45.930296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:45.931174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:45.931595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:45.932023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:45.932829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] RBAC: Adding query filter params (name=member) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:45.933267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:45.934835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:45.953472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 82/163] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:45.954530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:46.008347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9d5d0-0cde-4cd0-9c2a-559fca878bcc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.070674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619544b9-9441-47bc-9a52-16940343d3be None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.081365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.081931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.082214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.082492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.083231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=c7d67756f4974e5082afa5b9da96ddd0, user.id=d4028913228d4e89aa295f4b699c2726) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:46.083542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:46.085041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:46.106378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 82/164] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:45 2022] GET /identity/v3/role_assignments?user.id=d4028913228d4e89aa295f4b699c2726&scope.project.id=c7d67756f4974e5082afa5b9da96ddd0&role.id=e305aaac48e64ec7ae700613e1672700 => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:46.107246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:46.146280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.146942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.147218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.147487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.170179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:46.176963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:46.182316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:46.185920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 83/165] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:46.187040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:46.229510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:46.332235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b244-45e6-4e9e-bd5e-47dde0d25ff2 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.384818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35418ddf-7208-4bc5-8fa3-d6d531c4d6be None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.409078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.409862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.418204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.418204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.437908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:46.449146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:46.450179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:46.451529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:46.453691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 84/166] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:46.454592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:46.461374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.462035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.462313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.462574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.464760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:46.471134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:46.474790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 83/167] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:46 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:46.474790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:46.551938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:46.595991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e0236-e385-4ffd-95da-9c1954da175c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.607749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:46.619933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789b9f-51b1-41ad-a1d3-17a4a263dfef None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.639360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.640185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.640450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.640730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.641410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:46.641716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:46.643115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:46.655129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 84/168] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:46.656047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:46.667468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.668500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.669037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.669530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.670568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:46.671093 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:46.672848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:46.692429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 85/169] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:52:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:46.694548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:46.771750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fce52-f31d-4636-9203-c84e844b4167 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.822446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.823310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.823499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.826233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.851597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a54267-3308-4a52-8e7b-e968feb441d4 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:46.880598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:46.891933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:46.914378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:46.915426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:46.915958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:46.916438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] PATH_INFO: `/v3/users/dde84621695a4b64985c2f72dbefe3be` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:46.920701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] RBAC: Authorizing `identity:get_user(user_id=dde84621695a4b64985c2f72dbefe3be)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:46.922519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:46.924060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:46.924715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 86/170] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:46 2022] GET /identity/v3/users/dde84621695a4b64985c2f72dbefe3be => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:46.925700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:46.926985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.078756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 85/171] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:47.079632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.130659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db144655-2389-4813-90b9-3c4529abfd64 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:47.157588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:47.189315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832fbd7-67f1-4a67-bfae-66c1154eba02 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:47.228196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:47.228442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:47.229135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.229360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.229623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.229950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.230097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] PATH_INFO: `/v3/users/d4028913228d4e89aa295f4b699c2726` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.230500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.233546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] RBAC: Authorizing `identity:get_user(user_id=d4028913228d4e89aa295f4b699c2726)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:47.235300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:47.241011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 87/172] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:46 2022] GET /identity/v3/users/d4028913228d4e89aa295f4b699c2726 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:47.242684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.303564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:47.305921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:47.381328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:47.390515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:47.417602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 86/173] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:47.418504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.494770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c093b4ce-7b16-4014-90dd-8c3668e56e1c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:47.524937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e2366-168f-45b9-9df3-65d9009028cf None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:47.563687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:47.564346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.564698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.564897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.590036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:47.590694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.590978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.591255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.596641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:47.598298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:47.600311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 88/174] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:47 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:47.601685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.615393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:47.662704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:47.664148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:47.762143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d01581-de3d-4d20-ac06-c7b2148761d5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:47.787059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:47.797430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374648bf-f116-4593-a96b-fab8fe67bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:47.803052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374648bf-f116-4593-a96b-fab8fe67bf02 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.803052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374648bf-f116-4593-a96b-fab8fe67bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.803052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374648bf-f116-4593-a96b-fab8fe67bf02 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.803052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374648bf-f116-4593-a96b-fab8fe67bf02 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:47.803052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374648bf-f116-4593-a96b-fab8fe67bf02 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:47.803052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 89/175] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:47 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:47.804819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 87/176] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:47.805666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.809105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909243b4-3776-4465-960d-c18d9253b0bf None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.809394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909243b4-3776-4465-960d-c18d9253b0bf None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.809666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909243b4-3776-4465-960d-c18d9253b0bf None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.810994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 90/177] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:47.812038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353ee2-ce09-46c5-b903-fa14b453659b None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.812320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353ee2-ce09-46c5-b903-fa14b453659b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.812591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61353ee2-ce09-46c5-b903-fa14b453659b None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.814012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 91/178] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:47.816353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c61ac2-c7c3-4eba-af08-6ff78dbdd36f None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.816353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c61ac2-c7c3-4eba-af08-6ff78dbdd36f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.816353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c61ac2-c7c3-4eba-af08-6ff78dbdd36f None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.816824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 92/179] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:47.817666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8205847-66b3-483f-b9ec-aa099ab41593 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.818103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8205847-66b3-483f-b9ec-aa099ab41593 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.818208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8205847-66b3-483f-b9ec-aa099ab41593 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.819393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 93/180] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:47.820881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8205847-66b3-483f-b9ec-aa099ab41593 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.881670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:47.910967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec42b6-14bb-4e58-97c5-5d6e92dfb87d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:47.922923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8205847-66b3-483f-b9ec-aa099ab41593 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:47.944360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:47.945059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.945344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.945611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.946334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=d4028913228d4e89aa295f4b699c2726) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:47.946644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:47.948136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:47.953948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 88/181] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:47 2022] GET /identity/v3/role_assignments?user.id=d4028913228d4e89aa295f4b699c2726&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=e305aaac48e64ec7ae700613e1672700 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:47.954736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:47.959410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aa9cf-eaaf-4440-8df4-0d4d291f0de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:47.960076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aa9cf-eaaf-4440-8df4-0d4d291f0de0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.960362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aa9cf-eaaf-4440-8df4-0d4d291f0de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.961149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aa9cf-eaaf-4440-8df4-0d4d291f0de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.961912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aa9cf-eaaf-4440-8df4-0d4d291f0de0 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=dde84621695a4b64985c2f72dbefe3be) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:47.962229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aa9cf-eaaf-4440-8df4-0d4d291f0de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:47.964421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aa9cf-eaaf-4440-8df4-0d4d291f0de0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:47.971663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 94/182] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:47 2022] GET /identity/v3/role_assignments?user.id=dde84621695a4b64985c2f72dbefe3be&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:47.973163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7ae31-bb3f-4371-97ef-6e207e63d805 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:47.973456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7ae31-bb3f-4371-97ef-6e207e63d805 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:47.973997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7ae31-bb3f-4371-97ef-6e207e63d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:47.995322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3bb7ae31-bb3f-4371-97ef-6e207e63d805 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:47.996653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3bb7ae31-bb3f-4371-97ef-6e207e63d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:48.061041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:48.087352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 95/183] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:48.087352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9382a-120a-4162-b14f-f87fb4454f8e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.087352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9382a-120a-4162-b14f-f87fb4454f8e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.087352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9382a-120a-4162-b14f-f87fb4454f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.107132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6df9382a-120a-4162-b14f-f87fb4454f8e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:48.108567 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6df9382a-120a-4162-b14f-f87fb4454f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:48.124209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0efe06-b784-40a0-a407-be9acec29031 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:48.167409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1073a2-da23-468b-b00e-2c719e3825d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:48.168356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1073a2-da23-468b-b00e-2c719e3825d2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.168774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1073a2-da23-468b-b00e-2c719e3825d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.169188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1073a2-da23-468b-b00e-2c719e3825d2 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.170866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1073a2-da23-468b-b00e-2c719e3825d2 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:48.172916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1073a2-da23-468b-b00e-2c719e3825d2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:48.175124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 89/184] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:47 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:48.176877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f722-01f3-4b40-8696-e116407dfff2 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.177349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f722-01f3-4b40-8696-e116407dfff2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.182509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69f722-01f3-4b40-8696-e116407dfff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.193100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 96/185] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:48.195835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174d1bc-0688-4018-b757-090d84543ccb None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.196370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174d1bc-0688-4018-b757-090d84543ccb None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.196680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174d1bc-0688-4018-b757-090d84543ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.199744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:48.207962 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-aa69f722-01f3-4b40-8696-e116407dfff2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:48.218711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-aa69f722-01f3-4b40-8696-e116407dfff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:48.219325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f174d1bc-0688-4018-b757-090d84543ccb None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:48.220684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f174d1bc-0688-4018-b757-090d84543ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:48.316132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 90/186] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:48.317079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f722-01f3-4b40-8696-e116407dfff2 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:48.319555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 97/187] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:48.421371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69f722-01f3-4b40-8696-e116407dfff2 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:48.436879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174d1bc-0688-4018-b757-090d84543ccb None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:48.462061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:48.462678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.462952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.463224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.463976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] RBAC: Adding query filter params (role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=d4028913228d4e89aa295f4b699c2726) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:48.464289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:48.465762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:48.468552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:48.476605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 91/188] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:48 2022] GET /identity/v3/role_assignments?user.id=d4028913228d4e89aa295f4b699c2726&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:48.521639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:48.574723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:48.628450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174d1bc-0688-4018-b757-090d84543ccb None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:48.676976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:48.676976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.677266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.677514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.691622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:48.698395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:48.699292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:48.700221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 98/189] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:52:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:48.707742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:48.716753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df800c-f14d-4e71-b3c2-427ea8e5ce16 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:48.758145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:48.758973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.759310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.759637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.770098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:48.776153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:48.777043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:48.777849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 92/190] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:52:48.778499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:48.817078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451bdc2-c99e-42eb-8739-2297eae22c04 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:48.824726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:48.835387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:48.852932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:48.853567 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.853847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.854118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.864370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:48.869413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:48.870292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:48.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 99/191] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:48.871763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:48.881293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf4457-9f1e-411c-9a54-6f197a4e9e79 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:48.916444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:48.917103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:48.917381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:48.917656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:48.918310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:48.918606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:48.920000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:48.927815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 93/192] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:52:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:48.928509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:48.974341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e364fa-69a5-4005-ac3c-bdc228aee111 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.008210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.008818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.009098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.009371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.010485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.011979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.013542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 100/193] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:49.016748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.028302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33bf71-3317-40d2-9b0d-d7651488f57a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.047380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.050694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.061013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.061615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.061892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.062162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.062815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:49.063120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.064546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.073393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 94/194] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:49.074192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.114775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520417-efa2-4a8f-92b1-0e5a23fdea65 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.148926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.149506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.149781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.150057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.150718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:49.151019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.152437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.160603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 101/195] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:49.165744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.175160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e113ee-3ba3-45cc-a561-ea0f94e9676a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.209956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.210637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.211082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.211366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] PATH_INFO: `/v3/users/e6e6bc2f74cf4e588931902b25f5c862` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.228225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e6bc2f74cf4e588931902b25f5c862)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.229636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.231261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 95/196] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/users/e6e6bc2f74cf4e588931902b25f5c862 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:49.232071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.261012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.266868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2d145-6f55-4554-8f32-b99d070f58dc None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.272592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.301134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.301740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.302018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.302292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.302938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.304568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.330086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bd6cb-7806-48c0-98db-e876567d6554 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.364512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.365141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.365421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.365698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] PATH_INFO: `/v3/users/e6e6bc2f74cf4e588931902b25f5c862` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.366896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e6bc2f74cf4e588931902b25f5c862)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.368415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.370000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 96/197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/users/e6e6bc2f74cf4e588931902b25f5c862 => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:49.370772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.415622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 102/198] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:52:49 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:49.415622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.500228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933105b-cc52-42a6-b18a-6b94da857e84 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.510450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.534224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2d899-bcaf-4302-b5f1-eba6c391fdc6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.544742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.545491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.545827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.546155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] PATH_INFO: `/v3/users/37bbe5736d55415f8d8e328174eb1a70` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.547424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] RBAC: Authorizing `identity:get_user(user_id=37bbe5736d55415f8d8e328174eb1a70)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.548980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.550621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 97/199] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/users/37bbe5736d55415f8d8e328174eb1a70 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:49.551405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.581871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.582940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.582940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.583120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.614593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.668862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.674935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.682000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a967a-abc2-47c7-a83f-ffa3496df377 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.732556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.733207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.733482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.733764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:49.789633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.809158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 103/200] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:49.810023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.819352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:49.821681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:49.870691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:49.923345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6d380-d47f-4da5-a598-6f97ca9c7bac None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:49.942910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 98/201] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:49.948826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:49.963397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:49.964043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:49.964318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:49.964583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:50.033886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:50.043066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:50.044816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:50.060077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7fa0-775e-4ed4-9643-cc5e2fc91949 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:50.103507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:50.104210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:50.104492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:50.104768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:50.105931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:50.107408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:50.109102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 99/202] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:50.112328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:50.114992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:50.173081 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 104/203] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:50.173943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:50.231401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21972-f5ae-4df2-ad3a-9374ea670c5b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:50.267144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:50.267771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:50.268098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:50.268447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:50.269761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:50.270996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:50.272625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 100/204] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:50 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:50.276835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:50.289610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881ca38-77f6-4fdf-8a0d-875b4cfa7660 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:50.293343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:50.328190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:50.329312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:50.330053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:50.330504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:50.331426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] RBAC: Adding query filter params (role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=e6e6bc2f74cf4e588931902b25f5c862) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:50.331935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:50.335013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:50.347940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 105/205] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:50 2022] GET /identity/v3/role_assignments?user.id=e6e6bc2f74cf4e588931902b25f5c862&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:50.347940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:50.387032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:50.428065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1dca8d-50e4-45ff-bbf6-1a38b6e13fc3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:50.493985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:50.494632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:50.494908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:50.495178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:50.496431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:50.497897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:50.503546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 101/206] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:50 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:50.506216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:50.569070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13391b5c-ed17-4385-9c91-9379697aa9f0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:50.633787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:50.646744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bb2f1-06d5-4f2b-9d82-d55c999238bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:50.648663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb2f1-06d5-4f2b-9d82-d55c999238bc None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:50.648663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb2f1-06d5-4f2b-9d82-d55c999238bc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:50.650124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bb2f1-06d5-4f2b-9d82-d55c999238bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:50.651069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bb2f1-06d5-4f2b-9d82-d55c999238bc None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=e6e6bc2f74cf4e588931902b25f5c862) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:50.651588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bb2f1-06d5-4f2b-9d82-d55c999238bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:50.653209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bb2f1-06d5-4f2b-9d82-d55c999238bc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:50.664145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 106/207] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:50 2022] GET /identity/v3/role_assignments?user.id=e6e6bc2f74cf4e588931902b25f5c862&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:50.672944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3a03b-a353-4fe1-bde8-adced0b73579 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:50.735694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e17c40-0b01-4228-ad56-99aa6ce3e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:50.736361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17c40-0b01-4228-ad56-99aa6ce3e04a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:50.736640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17c40-0b01-4228-ad56-99aa6ce3e04a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:50.736910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17c40-0b01-4228-ad56-99aa6ce3e04a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:50.737657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e17c40-0b01-4228-ad56-99aa6ce3e04a None admin] RBAC: Adding query filter params (role.id=45c36965457d4c4e93c0f7bc2b98fad9, scope.project.id=83c883f6c4b74c0281aa45208ab7de42, user.id=37bbe5736d55415f8d8e328174eb1a70) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:50.737970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e17c40-0b01-4228-ad56-99aa6ce3e04a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:50.739453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e17c40-0b01-4228-ad56-99aa6ce3e04a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:50.747237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 102/208] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:50 2022] GET /identity/v3/role_assignments?user.id=37bbe5736d55415f8d8e328174eb1a70&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=45c36965457d4c4e93c0f7bc2b98fad9 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:51.606472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65441f85-3f0c-403f-9d6d-76a2d0000649 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:51.606983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65441f85-3f0c-403f-9d6d-76a2d0000649 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:51.607091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65441f85-3f0c-403f-9d6d-76a2d0000649 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:51.608631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 107/209] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:51.613964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ddd7-9d26-44eb-b3ee-73f964fcd349 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:51.614339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ddd7-9d26-44eb-b3ee-73f964fcd349 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:51.614518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ddd7-9d26-44eb-b3ee-73f964fcd349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:51.633217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2b46ddd7-9d26-44eb-b3ee-73f964fcd349 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:51.634425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2b46ddd7-9d26-44eb-b3ee-73f964fcd349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:51.681216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670fe24-8d02-4107-81f7-1c8ff80b57a6 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:51.681542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670fe24-8d02-4107-81f7-1c8ff80b57a6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:51.681767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670fe24-8d02-4107-81f7-1c8ff80b57a6 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:51.683379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 108/210] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:51.688612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b02cb-352e-4c56-a833-59714ac6221d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:51.688899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b02cb-352e-4c56-a833-59714ac6221d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:51.689177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b02cb-352e-4c56-a833-59714ac6221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:51.704353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 103/211] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:51.708238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-be6b02cb-352e-4c56-a833-59714ac6221d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:51.709457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-be6b02cb-352e-4c56-a833-59714ac6221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:51.782727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 109/212] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:51.971994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ddd7-9d26-44eb-b3ee-73f964fcd349 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:52.049388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:52.053021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b02cb-352e-4c56-a833-59714ac6221d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:52.070716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:52.078882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46ddd7-9d26-44eb-b3ee-73f964fcd349 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:52.116088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:52.116882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.117290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.117605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.128933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:52.135008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:52.135967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:52.137521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 104/213] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:52.141848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:52.164015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b02cb-352e-4c56-a833-59714ac6221d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:52.199804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:52.200592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.200947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.201292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.202631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:52.204337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:52.211582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 110/214] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:52.212542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:52.251190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba147a83-810c-4314-b3b0-4fe26279a9b7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:52.301332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:52.301979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.302262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.303054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.303745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:52.304715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:52.306808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:52.307848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:52.310158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:52.321884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 105/215] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:52.327802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:52.333737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8789575-4231-43e7-aeea-90675d9c1a22 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:52.380099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92348-65cc-4e29-955b-d501b27f35fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:52.380758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92348-65cc-4e29-955b-d501b27f35fe None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.381045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92348-65cc-4e29-955b-d501b27f35fe None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.383212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92348-65cc-4e29-955b-d501b27f35fe None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.383899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92348-65cc-4e29-955b-d501b27f35fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:52.386105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92348-65cc-4e29-955b-d501b27f35fe None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:52.454761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9ef2-bde9-4218-93fe-662c7f184091 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:52.492350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:52.492986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.493268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.493539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] PATH_INFO: `/v3/users/677818e1b7ea499790912d120d686794` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.508407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 111/216] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:52:52 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:52.508591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] RBAC: Authorizing `identity:get_user(user_id=677818e1b7ea499790912d120d686794)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:52.510045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:52.510406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf23eb5-a8cf-4ca9-a9a5-908a9e3dc9c9 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.510867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf23eb5-a8cf-4ca9-a9a5-908a9e3dc9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.511270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf23eb5-a8cf-4ca9-a9a5-908a9e3dc9c9 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.511801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 106/217] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:52 2022] GET /identity/v3/users/677818e1b7ea499790912d120d686794 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:52.513058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 112/218] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:52.517756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:52.527629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e7f0b-ed9a-4d60-9234-9c44343b7cb9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.527972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e7f0b-ed9a-4d60-9234-9c44343b7cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.528227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e7f0b-ed9a-4d60-9234-9c44343b7cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.554047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b80e7f0b-ed9a-4d60-9234-9c44343b7cb9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:52.555991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b80e7f0b-ed9a-4d60-9234-9c44343b7cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:52.606267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:52.680066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd7e1e-1e72-4726-b262-a859099a2a22 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:52.699964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 113/219] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:52.734909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:52.735696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.736143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.736513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.800019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d338-561c-4dc3-bc07-9622469353ad None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.800019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d338-561c-4dc3-bc07-9622469353ad None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.800019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3d338-561c-4dc3-bc07-9622469353ad None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.800019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 114/220] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:52.805180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469986-d9d1-439d-97de-e3b4293f3eae None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:52.807930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469986-d9d1-439d-97de-e3b4293f3eae None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:52.807930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6469986-d9d1-439d-97de-e3b4293f3eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:52.828126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f6469986-d9d1-439d-97de-e3b4293f3eae None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:52.829343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f6469986-d9d1-439d-97de-e3b4293f3eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:52.849280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:52.851597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:52.915301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:52.917533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:52.930741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 115/221] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:52.968091 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 107/222] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:52.975163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469986-d9d1-439d-97de-e3b4293f3eae None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.014451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.155982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6469986-d9d1-439d-97de-e3b4293f3eae None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:53.163568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87f7e8-b308-4c4e-847d-f6961ffb15e6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:53.193147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:53.194150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:53.194679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:53.195187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:53.196640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:53.198309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:53.200960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 116/223] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:52 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:53.207860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:53.207860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:53.207860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:53.207860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:53.209243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.231654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:53.237822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:53.238721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:53.239522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 108/224] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:52:53.245410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.274232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:53.297810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:53.328150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741de047-d690-4396-9c59-99226d3b02b4 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:53.363132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:53.363841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:53.364242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:53.364557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:53.365293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=677818e1b7ea499790912d120d686794) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:53.365604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:53.367617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:53.377929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 117/225] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/role_assignments?user.id=677818e1b7ea499790912d120d686794&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=e305aaac48e64ec7ae700613e1672700 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:53.379009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.417098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3942133-b2b9-45ac-b077-44abf5f9fa76 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:53.525479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:53.526111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:53.526395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:53.526669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:53.527362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:53.527658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:53.529213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:53.530428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa692f-978c-441b-9965-ef88f888d5c7 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:53.545084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 109/226] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:53.551422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.565390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:53.589787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:53.590223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:53.590501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:53.590774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:53.607146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:53.612003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:53.612883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:53.613688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 118/227] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:53.624927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.675173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:53.711691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96074e5-ec0f-4dc5-9d80-b890957b443e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:53.752423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:53.753075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:53.753354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:53.753627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] PATH_INFO: `/v3/users/e6e6bc2f74cf4e588931902b25f5c862` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:53.754876 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] RBAC: Authorizing `identity:get_user(user_id=e6e6bc2f74cf4e588931902b25f5c862)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:53.756451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:53.760759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 110/228] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/users/e6e6bc2f74cf4e588931902b25f5c862 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:53.767496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.843098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383c9b1-3bd4-4a55-ab48-de6ba8df5dc6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:53.890333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:53.891183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:53.891632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:53.892081 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:53.892893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:53.893355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:53.894886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:53.914687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 119/229] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:53.921852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:53.985831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e6d0-2ab8-458c-8528-d2e89bf2ddeb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:54.014681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:54.050116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:54.050777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:54.051065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:54.051350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:54.052602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:54.054607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:54.057432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 111/230] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:54.064941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:54.085100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94ca38-5e19-4da1-9473-fe076784687f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:54.091672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:54.140202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:54.141226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:54.141711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:54.142212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] PATH_INFO: `/v3/users/e6e6bc2f74cf4e588931902b25f5c862` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:54.143587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e6bc2f74cf4e588931902b25f5c862)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:54.146728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:54.150435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 120/231] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:53 2022] GET /identity/v3/users/e6e6bc2f74cf4e588931902b25f5c862 => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:54.157772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:54.273261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da952b-b41f-4110-bf58-7bf71e822785 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:54.335822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451c5b2-6ce2-460f-9062-41cad56ffd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:54.336518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c5b2-6ce2-460f-9062-41cad56ffd86 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:54.336799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c5b2-6ce2-460f-9062-41cad56ffd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:54.337075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c5b2-6ce2-460f-9062-41cad56ffd86 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/e6e6bc2f74cf4e588931902b25f5c862/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:54.341607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c5b2-6ce2-460f-9062-41cad56ffd86 None admin] RBAC: Authorizing `identity:create_grant(project_id=7930d95e9a4040bda3c164f09a0f510a, user_id=e6e6bc2f74cf4e588931902b25f5c862, role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:54.344921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c5b2-6ce2-460f-9062-41cad56ffd86 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:54.351511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcf948-824f-44ca-a424-fc51869d2fc4 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:54.370542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:54.388896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:54.389539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:54.389816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:54.390091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:54.391230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:54.392718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:54.394782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 121/232] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:54 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:54.400526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:54.454446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 112/233] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:54 2022] PUT /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/e6e6bc2f74cf4e588931902b25f5c862/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:52:54.526077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee1320-c3df-4138-b772-d5b3d85f3dca None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:54.563384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847bcfe-8f2f-4078-a9b5-fd28f885d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:54.564083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bcfe-8f2f-4078-a9b5-fd28f885d48c None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:54.564360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bcfe-8f2f-4078-a9b5-fd28f885d48c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:54.564639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847bcfe-8f2f-4078-a9b5-fd28f885d48c None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/e6e6bc2f74cf4e588931902b25f5c862/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:54.566701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847bcfe-8f2f-4078-a9b5-fd28f885d48c None admin] RBAC: Authorizing `identity:create_grant(project_id=7930d95e9a4040bda3c164f09a0f510a, user_id=e6e6bc2f74cf4e588931902b25f5c862, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:54.568356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847bcfe-8f2f-4078-a9b5-fd28f885d48c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:54.671445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 122/234] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:54 2022] PUT /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/e6e6bc2f74cf4e588931902b25f5c862/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:55.167330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777599b0-08a7-4338-b917-b7c5f074cafb None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:55.167868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777599b0-08a7-4338-b917-b7c5f074cafb None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:55.167972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777599b0-08a7-4338-b917-b7c5f074cafb None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:55.169435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 113/235] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:55.174789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bbfa2-0eeb-4cba-9708-48d4aa2ef7f8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:55.175196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bbfa2-0eeb-4cba-9708-48d4aa2ef7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:55.175383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bbfa2-0eeb-4cba-9708-48d4aa2ef7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:55.193819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cf2bbfa2-0eeb-4cba-9708-48d4aa2ef7f8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:55.195706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cf2bbfa2-0eeb-4cba-9708-48d4aa2ef7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:55.225718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187841-52d1-4cea-a398-a585ba18a224 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:55.226055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187841-52d1-4cea-a398-a585ba18a224 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:55.226538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187841-52d1-4cea-a398-a585ba18a224 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:55.228159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 114/236] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:52:55.233333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722527-fbed-439a-8c24-bc057617787f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:55.233620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722527-fbed-439a-8c24-bc057617787f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:55.233896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca722527-fbed-439a-8c24-bc057617787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:55.258674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:55.266753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ca722527-fbed-439a-8c24-bc057617787f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:55.268872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ca722527-fbed-439a-8c24-bc057617787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:55.313415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 123/237] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:55.389385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 115/238] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:55.564058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ad7ad-01b6-45cf-b12a-f76dde863c29 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:55.564407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ad7ad-01b6-45cf-b12a-f76dde863c29 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:55.564619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ad7ad-01b6-45cf-b12a-f76dde863c29 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:55.566134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 124/239] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:55.571648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20288-0335-4489-8f19-cbae002234e3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:55.571960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20288-0335-4489-8f19-cbae002234e3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:55.572238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20288-0335-4489-8f19-cbae002234e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:55.583344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:55.595012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ad7ad-01b6-45cf-b12a-f76dde863c29 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:55.603977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-dac20288-0335-4489-8f19-cbae002234e3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:55.603977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-dac20288-0335-4489-8f19-cbae002234e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:55.728309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 116/240] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:55.763214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ad7ad-01b6-45cf-b12a-f76dde863c29 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:55.800815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20288-0335-4489-8f19-cbae002234e3 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:55.814540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:55.815504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:55.816038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:55.816516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:55.843451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:55.853200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:55.854168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:52:55.854986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:55.858172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 125/241] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:52:55.862248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:55.930053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.009435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784af13-5485-4a57-b009-26390f46ec20 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.038401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20288-0335-4489-8f19-cbae002234e3 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.051723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.052343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.052618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.052886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.053553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:56.053851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:56.056102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:56.069446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 126/242] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:56.069446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.079986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.085714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.086746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.087282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.087762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.089114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:56.091030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:56.099513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 117/243] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:52:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:56.099513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.173560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.180604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8602bc-a2dc-49ef-a931-f30ea28976bf None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.207300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc7e52-0fb9-4a4e-83c5-afe4d994983d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.218845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.220025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.220750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.221225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.234288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:56.239773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:56.240793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:52:56.242151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:56.244582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 127/244] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:56.245625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.252815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.253463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.253747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.254025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] PATH_INFO: `/v3/users/238517a098074e73857b51eaf9b138d4` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.269987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] RBAC: Authorizing `identity:get_user(user_id=238517a098074e73857b51eaf9b138d4)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:56.271365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:56.273993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 118/245] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:56 2022] GET /identity/v3/users/238517a098074e73857b51eaf9b138d4 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:56.279372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.344654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.355572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80ca4-deea-4eed-91ab-ff5ff74e487b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.390170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9987e-9a92-4d20-94c3-111d0cb6f879 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.392978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.393839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.394320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.394783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.395621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:56.397337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:56.426980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.427594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.427873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.428280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.429029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:56.429336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:56.430723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:56.439351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 119/246] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:52:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:56.443947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.548552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77c0bc-b1ca-4a57-b776-1f05f4a377fc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.563794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 128/247] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:52:56 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:52:56.565856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.575005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.600457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36825ee8-628e-497e-b76e-48580c753db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.601624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36825ee8-628e-497e-b76e-48580c753db8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.602130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36825ee8-628e-497e-b76e-48580c753db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.602618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36825ee8-628e-497e-b76e-48580c753db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.605902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.683577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36825ee8-628e-497e-b76e-48580c753db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:56.685108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36825ee8-628e-497e-b76e-48580c753db8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:56.791406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd07b-9797-4d4c-a74f-c37e65801a0d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:56.807386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 120/248] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:52:56.808982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24d90-9dda-4264-8328-1b6787d6796f None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.809266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24d90-9dda-4264-8328-1b6787d6796f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.809540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24d90-9dda-4264-8328-1b6787d6796f None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.810969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 121/249] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:56.816116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273532d-9325-4e92-b92c-d985d77e5a84 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.816397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273532d-9325-4e92-b92c-d985d77e5a84 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.816674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273532d-9325-4e92-b92c-d985d77e5a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.838683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f273532d-9325-4e92-b92c-d985d77e5a84 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:56.839240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:56.839875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f273532d-9325-4e92-b92c-d985d77e5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:56.839999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:56.840188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:56.840460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] PATH_INFO: `/v3/users/677818e1b7ea499790912d120d686794` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:56.841617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] RBAC: Authorizing `identity:get_user(user_id=677818e1b7ea499790912d120d686794)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:56.844180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:56.846092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 129/250] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:56 2022] GET /identity/v3/users/677818e1b7ea499790912d120d686794 => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:56.846885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.864454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.939111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 122/251] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:56.940634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273532d-9325-4e92-b92c-d985d77e5a84 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:56.956287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:56.971562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b58fa6-8e69-4724-baf8-3d9f9b993dff None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:57.020383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:57.021022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.021298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.021569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.024473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:57.026880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:57.028980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 130/252] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:56 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:57.036482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:57.081646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273532d-9325-4e92-b92c-d985d77e5a84 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:57.135755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:57.136354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.136637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.136899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.138043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:57.140893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:57.142567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 123/253] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:56 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:57.148859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:57.184441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e142b-f17e-4e5f-b61e-4734da0884b9 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:57.186808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:57.248737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31199d-e3e8-43a5-bf0a-3eb73e7746c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:57.249361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31199d-e3e8-43a5-bf0a-3eb73e7746c1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.249636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31199d-e3e8-43a5-bf0a-3eb73e7746c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.249913 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31199d-e3e8-43a5-bf0a-3eb73e7746c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.250654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31199d-e3e8-43a5-bf0a-3eb73e7746c1 None admin] RBAC: Adding query filter params (role.id=45c36965457d4c4e93c0f7bc2b98fad9, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=238517a098074e73857b51eaf9b138d4) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:57.250965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31199d-e3e8-43a5-bf0a-3eb73e7746c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:57.252473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31199d-e3e8-43a5-bf0a-3eb73e7746c1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:57.258867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 131/254] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:57 2022] GET /identity/v3/role_assignments?user.id=238517a098074e73857b51eaf9b138d4&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=45c36965457d4c4e93c0f7bc2b98fad9 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:57.264185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38599-4ef0-4013-ab3c-41ffa52f0884 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.264514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38599-4ef0-4013-ab3c-41ffa52f0884 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.264795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e38599-4ef0-4013-ab3c-41ffa52f0884 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.266493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 132/255] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:57.267262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e38599-4ef0-4013-ab3c-41ffa52f0884 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:57.303441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:57.332186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3c2de-df18-44ca-990e-eec192a9ecfb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:57.406929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:57.407892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.409318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.409788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/677818e1b7ea499790912d120d686794/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.413162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] RBAC: Authorizing `identity:create_grant(project_id=7930d95e9a4040bda3c164f09a0f510a, user_id=677818e1b7ea499790912d120d686794, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:57.415406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:57.454146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e38599-4ef0-4013-ab3c-41ffa52f0884 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:57.493559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6bfea-8219-40d0-83a9-c5495bf39520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:57.494201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6bfea-8219-40d0-83a9-c5495bf39520 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.494507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6bfea-8219-40d0-83a9-c5495bf39520 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.494803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6bfea-8219-40d0-83a9-c5495bf39520 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.508492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6bfea-8219-40d0-83a9-c5495bf39520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c3c6bfea-8219-40d0-83a9-c5495bf39520 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:57.513915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:57.514810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:52:57.515622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 133/256] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:52:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:57.516321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb87c6-f53e-4748-9201-b8a10afc6dfe None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.516700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb87c6-f53e-4748-9201-b8a10afc6dfe None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.516838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb87c6-f53e-4748-9201-b8a10afc6dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.540664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-81bb87c6-f53e-4748-9201-b8a10afc6dfe None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:57.542813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-81bb87c6-f53e-4748-9201-b8a10afc6dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:57.544041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 124/257] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:52:57 2022] PUT /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/677818e1b7ea499790912d120d686794/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:52:57.545102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:57.641668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 134/258] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:52:57.732179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:57.766215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b46cb7-85d4-4e4f-8592-315c3b27f87c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:57.815318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:57.815963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:57.816246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:57.816521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:57.817206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:57.817512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:57.818928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:57.832522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 125/259] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:52:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:57.838927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb87c6-f53e-4748-9201-b8a10afc6dfe None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:57.842025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:57.970939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb87c6-f53e-4748-9201-b8a10afc6dfe None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:58.012062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:58.012700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:58.012979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:58.013252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] PATH_INFO: `/v3/users/e6e6bc2f74cf4e588931902b25f5c862` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:58.014383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e6bc2f74cf4e588931902b25f5c862)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:58.015854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:58.017500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 135/260] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:57 2022] GET /identity/v3/users/e6e6bc2f74cf4e588931902b25f5c862 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:58.022428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.023588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.134690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127fb5-6bad-4c04-8ce5-1172b01552ef None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:58.143071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:58.172856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:58.173700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:58.174168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:58.174590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:58.183347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:58.187897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:52:58.193254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:52:58.200177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:52:58.201079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 126/261] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:52:58.204543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.210095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc48fe-8596-4eca-92ea-641056047610 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:58.316634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:58.317269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:58.317547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:58.317876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:58.320532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d0724-2c43-4e3e-a5fa-66b000f32ee7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:58.358620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:58.360123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:58.360606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:58.361124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:58.361996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:58.362516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:58.364281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:58.374283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 127/262] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:58.380083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.447834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:58.488946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:58.490461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:58.492410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e6540-b157-4e50-a070-6ba1c46821c5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:58.531988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:58.533025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:58.533663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:58.534942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] PATH_INFO: `/v3/users/e6e6bc2f74cf4e588931902b25f5c862` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:58.539652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] RBAC: Authorizing `identity:get_user(user_id=e6e6bc2f74cf4e588931902b25f5c862)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:58.541588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:58.545142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 128/263] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/users/e6e6bc2f74cf4e588931902b25f5c862 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:58.552248 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.604356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:58.629938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 136/264] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 04:52:58.635600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.662713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1ed55-5e36-4db6-938f-6ae2388728cd None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:58.694980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:58.702510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:58.706038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:58.706638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:58.707112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:58.736636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0e5d6-ad7e-4e57-a8a2-3a6ce2faa3b5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:58.773627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:58.774302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:58.774793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:58.774793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:58.776034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:58.777563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:58.779544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 137/265] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:58.785435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.786890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:58.789562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:58.852452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:58.902773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 129/266] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 04:52:58.911625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:58.955455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:58.958532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e97f0d-ad79-428b-8b66-4d549d19eb05 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:59.016973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:59.017596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:59.017871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:59.018142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:59.018883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] RBAC: Adding query filter params (role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=e6e6bc2f74cf4e588931902b25f5c862) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:59.019189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:59.028795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:59.035235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 138/267] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/role_assignments?user.id=e6e6bc2f74cf4e588931902b25f5c862&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:52:59.035585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3aa6a-4576-4224-9744-ddbc9fc51789 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:59.075137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e1edf-8316-4090-834a-eda39a9aa54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:59.076242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e1edf-8316-4090-834a-eda39a9aa54f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:59.076747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e1edf-8316-4090-834a-eda39a9aa54f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:59.077226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e1edf-8316-4090-834a-eda39a9aa54f None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:59.078783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e1edf-8316-4090-834a-eda39a9aa54f None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:59.080598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e1edf-8316-4090-834a-eda39a9aa54f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:59.082856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 130/268] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:52:58 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:59.093129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:52:59.247320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5664fa-60bd-4e2a-8987-39f73aa7b20d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:52:59.249715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:52:59.296917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c84acc-5f1d-4718-96c0-fd798750953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:52:59.297531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84acc-5f1d-4718-96c0-fd798750953c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:59.297806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84acc-5f1d-4718-96c0-fd798750953c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:59.298074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c84acc-5f1d-4718-96c0-fd798750953c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:59.298808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c84acc-5f1d-4718-96c0-fd798750953c None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=e6e6bc2f74cf4e588931902b25f5c862) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:52:59.299112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c84acc-5f1d-4718-96c0-fd798750953c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:52:59.300594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c84acc-5f1d-4718-96c0-fd798750953c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:52:59.309010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 139/269] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:52:59 2022] GET /identity/v3/role_assignments?user.id=e6e6bc2f74cf4e588931902b25f5c862&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:52:59.655371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeb50f-e318-428e-bc15-a5f11e7f1efe None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:59.655856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeb50f-e318-428e-bc15-a5f11e7f1efe None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:59.655856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeb50f-e318-428e-bc15-a5f11e7f1efe None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:59.657492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 131/270] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:59.663057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7f879-5f96-4d58-b037-f32b1d17def1 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:59.663535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7f879-5f96-4d58-b037-f32b1d17def1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:59.663819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7f879-5f96-4d58-b037-f32b1d17def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:59.689342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b5a7f879-5f96-4d58-b037-f32b1d17def1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:59.689342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b5a7f879-5f96-4d58-b037-f32b1d17def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:59.769477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 140/271] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:52:59.799835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc12c28-5fb8-482c-92be-5d45a1024ea7 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:59.800217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc12c28-5fb8-482c-92be-5d45a1024ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:59.800431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc12c28-5fb8-482c-92be-5d45a1024ea7 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:59.802108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 132/272] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:52:59.808139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3ece7-e2cf-46e1-85ba-0f83a9858748 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:52:59.808717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3ece7-e2cf-46e1-85ba-0f83a9858748 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:52:59.809195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3ece7-e2cf-46e1-85ba-0f83a9858748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:52:59.829339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9be3ece7-e2cf-46e1-85ba-0f83a9858748 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:52:59.830861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9be3ece7-e2cf-46e1-85ba-0f83a9858748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:52:59.913673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 141/273] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:00.096388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc12c28-5fb8-482c-92be-5d45a1024ea7 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:00.198687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3ece7-e2cf-46e1-85ba-0f83a9858748 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:00.205994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc12c28-5fb8-482c-92be-5d45a1024ea7 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:00.208207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:00.227309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:00.245276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00779641-ec7b-4d58-b07c-cbcb4516731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:00.245920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00779641-ec7b-4d58-b07c-cbcb4516731c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.246201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00779641-ec7b-4d58-b07c-cbcb4516731c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.246478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00779641-ec7b-4d58-b07c-cbcb4516731c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.247616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00779641-ec7b-4d58-b07c-cbcb4516731c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:00.249151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00779641-ec7b-4d58-b07c-cbcb4516731c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:00.250762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 133/274] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:00.251892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7aec-aec1-413a-a6b7-64ad684a5c9f None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.252197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7aec-aec1-413a-a6b7-64ad684a5c9f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.252475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b7aec-aec1-413a-a6b7-64ad684a5c9f None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.253801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 134/275] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:00.256258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b7aec-aec1-413a-a6b7-64ad684a5c9f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:00.311355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3ece7-e2cf-46e1-85ba-0f83a9858748 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:00.361202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1c65e-71e5-42a3-bc75-85b4d362f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:00.362247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1c65e-71e5-42a3-bc75-85b4d362f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.362733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1c65e-71e5-42a3-bc75-85b4d362f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.363218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1c65e-71e5-42a3-bc75-85b4d362f8b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.372850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b7aec-aec1-413a-a6b7-64ad684a5c9f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:00.383106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1c65e-71e5-42a3-bc75-85b4d362f8b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-19e1c65e-71e5-42a3-bc75-85b4d362f8b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:00.387872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:00.388759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:00.389689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 142/276] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:00.393434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb738-e4f2-43f8-aef0-7ca08454659b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.393722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb738-e4f2-43f8-aef0-7ca08454659b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.394003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aeb738-e4f2-43f8-aef0-7ca08454659b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.412090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4353e28-6cf9-40e8-a516-5e03e458cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:00.412700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353e28-6cf9-40e8-a516-5e03e458cc1f None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.414570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353e28-6cf9-40e8-a516-5e03e458cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.414570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4353e28-6cf9-40e8-a516-5e03e458cc1f None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.414870 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4353e28-6cf9-40e8-a516-5e03e458cc1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:00.416262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-44aeb738-e4f2-43f8-aef0-7ca08454659b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:00.416399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4353e28-6cf9-40e8-a516-5e03e458cc1f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:00.417464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-44aeb738-e4f2-43f8-aef0-7ca08454659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:00.485131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 143/277] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:00.485909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb738-e4f2-43f8-aef0-7ca08454659b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:00.503418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:00.571936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 135/278] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:53:00 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:53:00.571936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015076f0-a05a-41ea-a670-c240e7c0cda1 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.571936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015076f0-a05a-41ea-a670-c240e7c0cda1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.571936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015076f0-a05a-41ea-a670-c240e7c0cda1 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.571936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 136/279] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:00.571936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238124bb-238a-4e8a-afe8-f73f835ab9ac None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.571936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238124bb-238a-4e8a-afe8-f73f835ab9ac None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.572554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238124bb-238a-4e8a-afe8-f73f835ab9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.592404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-238124bb-238a-4e8a-afe8-f73f835ab9ac None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:00.593662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-238124bb-238a-4e8a-afe8-f73f835ab9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:00.608328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aeb738-e4f2-43f8-aef0-7ca08454659b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:00.614228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:00.664501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:00.665291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.665619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.665967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.667303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:00.668113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:00.670458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:00.685563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 137/280] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:00.686096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 144/281] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:00.693907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238124bb-238a-4e8a-afe8-f73f835ab9ac None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:00.761729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:00.809655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238124bb-238a-4e8a-afe8-f73f835ab9ac None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:00.856052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:00.858016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.858303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.858575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] PATH_INFO: `/v3/users/ea0d03bf54084f818f1ce5e0eb6ee317` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.865029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:00.882377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0d03bf54084f818f1ce5e0eb6ee317)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:00.883848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:00.885911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 138/282] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:00 2022] GET /identity/v3/users/ea0d03bf54084f818f1ce5e0eb6ee317 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:00.893099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:00.895574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a11ee0-b9bb-474f-abaf-d61064cacbf5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:00.911524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:00.945150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:00.946220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:00.946702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:00.947173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:00.960576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:00.966505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:00.967432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:00.968297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:00.969607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 145/283] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:00.971446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.019004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d37de-0095-4da9-b19c-f53f47394dd0 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.057369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.058031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.058313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.058585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.059316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, user.id=ea0d03bf54084f818f1ce5e0eb6ee317, scope.system=all) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:01.059622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.061092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:01.067103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 139/284] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 25 04:53:00 2022] GET /identity/v3/role_assignments?user.id=ea0d03bf54084f818f1ce5e0eb6ee317&scope.system=all&role.id=e305aaac48e64ec7ae700613e1672700 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:01.068011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.102146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cb00a-07ca-4ab8-865b-afd873fe419a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.141905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.142545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.142874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.143246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.151845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:01.154239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:01.157973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:01.162863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:01.164442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:01.165244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 146/285] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:01.171447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.183306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f58eff-b50f-4bd3-b573-99809e87f094 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.221955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.222616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.222896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.223222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.224182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:01.224488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.226465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:01.235854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 140/286] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:01.242222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.288674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f516ae5-3a93-4410-b6f9-8fdb5a0e8d7e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.327947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.328707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.328940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.329211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.329991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:01.330299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.331719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:01.346325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 147/287] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:01.347671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.354933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190405f2-4d70-42fe-bf6a-5475c727fb09 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.392342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.392980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.393314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.393591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] PATH_INFO: `/v3/users/238517a098074e73857b51eaf9b138d4` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.394732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] RBAC: Authorizing `identity:get_user(user_id=238517a098074e73857b51eaf9b138d4)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.396308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:01.397952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 141/288] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:01 2022] GET /identity/v3/users/238517a098074e73857b51eaf9b138d4 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:01.403417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.407320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:01.414859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:01.487610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9371a0-764a-42e7-a80e-df2e0fe19db2 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.510047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e669e24-9115-40c8-bba7-4fe6db7e5814 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.545581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.546227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.546505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.546778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.547952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.549735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:01.550501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.551144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.551423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.551694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] PATH_INFO: `/v3/users/677818e1b7ea499790912d120d686794` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.551900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 142/289] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:01 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:01.556775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] RBAC: Authorizing `identity:get_user(user_id=677818e1b7ea499790912d120d686794)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.558147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.558444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:01.560405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 148/290] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:01 2022] GET /identity/v3/users/677818e1b7ea499790912d120d686794 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:01.566050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:01.638967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:01.666084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9bee1-0436-4763-b98f-cd991b5a567e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.702556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.703313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.707928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.707928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/238517a098074e73857b51eaf9b138d4/roles/45c36965457d4c4e93c0f7bc2b98fad9` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.707928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] RBAC: Authorizing `identity:create_grant(project_id=7930d95e9a4040bda3c164f09a0f510a, user_id=238517a098074e73857b51eaf9b138d4, role_id=45c36965457d4c4e93c0f7bc2b98fad9)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.707928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:01.768784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd302-a7d3-4d2f-aa58-d217476f4603 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:01.779101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 143/291] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:53:01 2022] PUT /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a/users/238517a098074e73857b51eaf9b138d4/roles/45c36965457d4c4e93c0f7bc2b98fad9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:53:01.806453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:01.815122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:01.816037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:01.816350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:01.816588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:01.892957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:01.894479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:02.005134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 149/292] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 04:53:02.012629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:02.126526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a4e1-4484-4c8f-8f5a-799dba46be0f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:02.157754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:02.163818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e94916-9f00-4e18-8c19-ea86c357df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:02.164521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94916-9f00-4e18-8c19-ea86c357df4a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:02.164797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94916-9f00-4e18-8c19-ea86c357df4a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:02.165069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e94916-9f00-4e18-8c19-ea86c357df4a None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:02.166455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94916-9f00-4e18-8c19-ea86c357df4a None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:02.168047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e94916-9f00-4e18-8c19-ea86c357df4a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:02.170044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 144/293] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:02 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:02.176768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:02.211875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:02.289941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450ac6c-63da-4183-924c-05fcc7ba35d0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:02.324795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924003f0-15b7-4945-aa46-6013505efd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:02.325742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924003f0-15b7-4945-aa46-6013505efd40 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:02.326360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924003f0-15b7-4945-aa46-6013505efd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:02.326828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924003f0-15b7-4945-aa46-6013505efd40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:02.327768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924003f0-15b7-4945-aa46-6013505efd40 None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=677818e1b7ea499790912d120d686794) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:02.328296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924003f0-15b7-4945-aa46-6013505efd40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:02.330352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924003f0-15b7-4945-aa46-6013505efd40 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:02.337079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 150/294] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:02 2022] GET /identity/v3/role_assignments?user.id=677818e1b7ea499790912d120d686794&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=e305aaac48e64ec7ae700613e1672700 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:03.116272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658814-941a-4f86-9f4f-e3fe0f623586 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.116810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658814-941a-4f86-9f4f-e3fe0f623586 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.117235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658814-941a-4f86-9f4f-e3fe0f623586 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.118626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 145/295] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:03.123825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5f83-752b-45b5-840f-8142ba35cf43 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.124139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5f83-752b-45b5-840f-8142ba35cf43 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.124412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b5f83-752b-45b5-840f-8142ba35cf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.143200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-578b5f83-752b-45b5-840f-8142ba35cf43 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:03.144418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-578b5f83-752b-45b5-840f-8142ba35cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:03.186160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff546a-9b42-4dea-944f-b40b62d1b13a None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.186790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff546a-9b42-4dea-944f-b40b62d1b13a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.187257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff546a-9b42-4dea-944f-b40b62d1b13a None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.188834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 146/296] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:53:03.193900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2d3c-e772-41ab-86be-247261df0dd3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.194910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2d3c-e772-41ab-86be-247261df0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.195381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2d3c-e772-41ab-86be-247261df0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.217232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 151/297] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:03.219348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-848b2d3c-e772-41ab-86be-247261df0dd3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:03.224114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-848b2d3c-e772-41ab-86be-247261df0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:03.294674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 147/298] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:03.401757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af6ef-dc86-43c2-9ab8-d9175bea98f4 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.402593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af6ef-dc86-43c2-9ab8-d9175bea98f4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.403014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af6ef-dc86-43c2-9ab8-d9175bea98f4 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.404786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 152/299] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:03.410092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35c90-4e62-4e1d-84ea-22332662ab50 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.410376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35c90-4e62-4e1d-84ea-22332662ab50 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.420326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35c90-4e62-4e1d-84ea-22332662ab50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.430279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f7f35c90-4e62-4e1d-84ea-22332662ab50 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:03.431530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f7f35c90-4e62-4e1d-84ea-22332662ab50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:03.488743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3af6ef-dc86-43c2-9ab8-d9175bea98f4 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:03.502832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 148/300] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:03.513945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:03.572796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35c90-4e62-4e1d-84ea-22332662ab50 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:03.598119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3af6ef-dc86-43c2-9ab8-d9175bea98f4 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:03.635163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:03.635806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.636109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.636432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.637600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:03.637708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:03.639125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:03.641772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 153/301] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:03.648984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:03.687042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35c90-4e62-4e1d-84ea-22332662ab50 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:03.724299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:03.724934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.725205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.725558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.737185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:03.743084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:03.744214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:03.745234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:03.748970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 149/302] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:03.750020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:03.751485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:03.759899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b161bd-1b21-411c-820c-4f9c7fd02c40 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:03.801519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:03.802131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.802409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.802674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] PATH_INFO: `/v3/groups` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.803384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:03.805738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:03.858289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efc5a4-d3d4-429a-a957-4cba2277aab0 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:03.875623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 154/303] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Aug 25 04:53:03 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:03.876853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:03.879810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:03.906538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:03.907619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:03.907899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:03.908199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:03.908897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:03.909544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:03.911704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:03.925478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 150/304] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:03.932204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:04.006553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf29456-121f-401c-bd4b-03f13aef31d0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:04.048599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9396ca-bd7e-4ed8-901d-4fb600c21849 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:04.056706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:04.057346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.057627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.057901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.071142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:04.076358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:04.077293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:04.078106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 155/305] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:04.084771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:04.087017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:04.087659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.087971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.089922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] PATH_INFO: `/v3/users/40a56b2a275f4d8287fe2c99a8d0644e` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.101236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:04.108054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] RBAC: Authorizing `identity:get_user(user_id=40a56b2a275f4d8287fe2c99a8d0644e)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:04.109261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:04.115636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 151/306] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:03 2022] GET /identity/v3/users/40a56b2a275f4d8287fe2c99a8d0644e => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:04.117132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:04.171107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:04.206427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b89bf-0898-40b5-a526-b075562a7f1e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:04.241810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334a8b8-a475-47bd-9637-85f805acaf5b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:04.244047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703d6c7-f9b1-4ddc-9dba-022501095d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:04.244669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703d6c7-f9b1-4ddc-9dba-022501095d8b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.244947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703d6c7-f9b1-4ddc-9dba-022501095d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.245222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703d6c7-f9b1-4ddc-9dba-022501095d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.245893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703d6c7-f9b1-4ddc-9dba-022501095d8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:04.246197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703d6c7-f9b1-4ddc-9dba-022501095d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:04.247607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703d6c7-f9b1-4ddc-9dba-022501095d8b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:04.264631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 156/307] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:04.264631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690409f4-492b-41d7-8078-2157233a7f15 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.264631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690409f4-492b-41d7-8078-2157233a7f15 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.264631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690409f4-492b-41d7-8078-2157233a7f15 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.264631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 157/308] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:04.268408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690409f4-492b-41d7-8078-2157233a7f15 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:04.286604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b03c90-8835-4463-b781-38b4a20edec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:04.287221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b03c90-8835-4463-b781-38b4a20edec8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.287500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b03c90-8835-4463-b781-38b4a20edec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.287778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b03c90-8835-4463-b781-38b4a20edec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.288955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b03c90-8835-4463-b781-38b4a20edec8 None admin] RBAC: Adding query filter params (role.id=45c36965457d4c4e93c0f7bc2b98fad9, user.id=40a56b2a275f4d8287fe2c99a8d0644e, scope.system=all) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:04.289274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b03c90-8835-4463-b781-38b4a20edec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:04.290733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b03c90-8835-4463-b781-38b4a20edec8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:04.295855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 152/309] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 25 04:53:04 2022] GET /identity/v3/role_assignments?user.id=40a56b2a275f4d8287fe2c99a8d0644e&scope.system=all&role.id=45c36965457d4c4e93c0f7bc2b98fad9 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:04.309464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c89f7-b2ab-4e99-924e-801576931bd7 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.309749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c89f7-b2ab-4e99-924e-801576931bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.310030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c89f7-b2ab-4e99-924e-801576931bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.333292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d09c89f7-b2ab-4e99-924e-801576931bd7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:04.334532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d09c89f7-b2ab-4e99-924e-801576931bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:04.358338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:04.393656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690409f4-492b-41d7-8078-2157233a7f15 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:04.430916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 153/310] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:04.435148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:04.435795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.436115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.436395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] PATH_INFO: `/v3/users/ea0d03bf54084f818f1ce5e0eb6ee317` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.440942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0d03bf54084f818f1ce5e0eb6ee317)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:04.442466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:04.444588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 158/311] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:04 2022] GET /identity/v3/users/ea0d03bf54084f818f1ce5e0eb6ee317 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:04.450008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c89f7-b2ab-4e99-924e-801576931bd7 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:04.489960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:04.557335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c89f7-b2ab-4e99-924e-801576931bd7 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:04.597482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:04.598147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.598415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.598690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] PATH_INFO: `/v3/system/users/ea0d03bf54084f818f1ce5e0eb6ee317/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.600393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea0d03bf54084f818f1ce5e0eb6ee317, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:04.602716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:04.692784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 154/312] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Aug 25 04:53:04 2022] PUT /identity/v3/system/users/ea0d03bf54084f818f1ce5e0eb6ee317/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:04.746161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:04.861928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244138e-fe31-43cb-867d-74e0a6ffa5c2 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:04.898810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:04.899796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:04.900356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:04.900832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:04.909203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:04.913792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:04.918809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:04.921108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:04.922267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 159/313] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:04.926357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:05.031894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:05.036231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79526c7f-e4f3-481c-bde6-0185d87f349c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:05.073827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:05.074443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:05.074723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:05.074992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:05.075658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:05.076048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:05.077358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:05.086873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 155/314] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:05.092014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:05.196783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e002ec-a046-4673-ab95-1eb95c00d5bf None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:05.234669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:05.235359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:05.235642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:05.235937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] PATH_INFO: `/v3/users/238517a098074e73857b51eaf9b138d4` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:05.237097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] RBAC: Authorizing `identity:get_user(user_id=238517a098074e73857b51eaf9b138d4)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:05.238547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:05.240627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 160/315] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:05 2022] GET /identity/v3/users/238517a098074e73857b51eaf9b138d4 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:05.247011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:05.354483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304d664-ce0c-48ea-a527-508833db1ea7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:05.393416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:05.394050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:05.394334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:05.394612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:05.425558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:05.469239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:05.470803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:05.578444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 156/316] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:05.584097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:05.656521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:05.692180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c28954-082c-4503-8eed-8e2d59cc2d28 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:05.732418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0afe6-78ec-497f-842b-be4aa3e5637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:05.733295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0afe6-78ec-497f-842b-be4aa3e5637d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:05.733643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0afe6-78ec-497f-842b-be4aa3e5637d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:05.733923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0afe6-78ec-497f-842b-be4aa3e5637d None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:05.735112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0afe6-78ec-497f-842b-be4aa3e5637d None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:05.736688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0afe6-78ec-497f-842b-be4aa3e5637d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:05.738652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 161/317] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:05 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:05.744684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:05.808299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:05.851748 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9f6a-b51f-45e3-8350-75033985b6dc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:05.877123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c7e7-7163-472b-a91c-cf51a1c6b107 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:05.877422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c7e7-7163-472b-a91c-cf51a1c6b107 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:05.877670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c7e7-7163-472b-a91c-cf51a1c6b107 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:05.879268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 162/318] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:53:05.884422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6c5e-7fe0-47fd-9c32-158345cb7775 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:05.884705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6c5e-7fe0-47fd-9c32-158345cb7775 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:05.884976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c6c5e-7fe0-47fd-9c32-158345cb7775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:05.889082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:05.889698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:05.889980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:05.890254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:05.890989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] RBAC: Adding query filter params (role.id=45c36965457d4c4e93c0f7bc2b98fad9, scope.project.id=7930d95e9a4040bda3c164f09a0f510a, user.id=238517a098074e73857b51eaf9b138d4) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:05.891301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:05.892799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:05.901243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 157/319] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:05 2022] GET /identity/v3/role_assignments?user.id=238517a098074e73857b51eaf9b138d4&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=45c36965457d4c4e93c0f7bc2b98fad9 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:05.906329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e15c6c5e-7fe0-47fd-9c32-158345cb7775 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:05.907993 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e15c6c5e-7fe0-47fd-9c32-158345cb7775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:05.993227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 163/320] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:06.259104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:06.344198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400db01-445d-43d9-b441-60d98bb979ae None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:06.344485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400db01-445d-43d9-b441-60d98bb979ae None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:06.344765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400db01-445d-43d9-b441-60d98bb979ae None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:06.346134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 164/321] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:53:06.351438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3490-d15a-4599-b643-3af167ec6da2 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:06.351731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3490-d15a-4599-b643-3af167ec6da2 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:06.352039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f3490-d15a-4599-b643-3af167ec6da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:06.365638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab506925-d2f8-4c13-96e7-7c71d9e3dc26 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:06.370770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a63f3490-d15a-4599-b643-3af167ec6da2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:06.372006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a63f3490-d15a-4599-b643-3af167ec6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:06.390099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:06.403311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:06.404220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:06.414427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:06.414427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:06.414427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:06.414427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:06.414427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 158/322] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:06.416618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:06.437662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:06.446096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 165/323] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:06.521880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c49f5a-bad7-4d06-aeda-0bd341ebedec None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:06.556859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c7bee-ffa9-48f0-9b41-ce8dd269c3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:06.557473 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c7bee-ffa9-48f0-9b41-ce8dd269c3c1 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:06.557755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c7bee-ffa9-48f0-9b41-ce8dd269c3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:06.558028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c7bee-ffa9-48f0-9b41-ce8dd269c3c1 None admin] PATH_INFO: `/v3/groups` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:06.558652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c7bee-ffa9-48f0-9b41-ce8dd269c3c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:06.560147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c7bee-ffa9-48f0-9b41-ce8dd269c3c1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:06.659122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 159/324] 10.222.0.45 () {60 vars in 1134 bytes} [Thu Aug 25 04:53:06 2022] POST /identity/v3/groups => generated 226 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:53:06.715887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3490-d15a-4599-b643-3af167ec6da2 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:06.784040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d483b-6dd6-448f-a848-aae39e65e4dc None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:06.784837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d483b-6dd6-448f-a848-aae39e65e4dc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:06.785831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d483b-6dd6-448f-a848-aae39e65e4dc None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:06.788186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 160/325] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:06.793786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705efd-7c4a-4407-ac22-879a9ef9d4c4 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:06.794868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705efd-7c4a-4407-ac22-879a9ef9d4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:06.796583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1705efd-7c4a-4407-ac22-879a9ef9d4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:06.818205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d1705efd-7c4a-4407-ac22-879a9ef9d4c4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:06.820619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d1705efd-7c4a-4407-ac22-879a9ef9d4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:06.827670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f3490-d15a-4599-b643-3af167ec6da2 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:06.869179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:06.869834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:06.870131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:06.870386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:06.874894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:06.881106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:06.886078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:06.887792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:06.888817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 166/326] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:06.893275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:06.896685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 161/327] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:06.956836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:07.003492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25385a0-5c17-4da7-a132-d643cfbb86e5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:07.039588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:07.040160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:07.040483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:07.040757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:07.041433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:07.041733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:07.043122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:07.051822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 167/328] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:07.057555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705efd-7c4a-4407-ac22-879a9ef9d4c4 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:07.164634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1705efd-7c4a-4407-ac22-879a9ef9d4c4 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:07.176839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:07.203939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:07.204617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:07.204893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:07.205205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] PATH_INFO: `/v3/users/40a56b2a275f4d8287fe2c99a8d0644e` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:07.206361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] RBAC: Authorizing `identity:get_user(user_id=40a56b2a275f4d8287fe2c99a8d0644e)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:07.207808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:07.209427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 162/329] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:07 2022] GET /identity/v3/users/40a56b2a275f4d8287fe2c99a8d0644e => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:07.215079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:07.277621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:07.301467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001b7a3-dd05-4963-9a23-1024d3d0b15a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:07.320668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:07.342976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:07.343612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:07.343886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:07.345949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb34f6a-d5d0-4b0f-b2d4-67b7a8485a1e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:07.346060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:07.365844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:07.375865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:07.376842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:07.377656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:07.385876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 168/330] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:07.386997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:07.397853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:07.399039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:07.399039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:07.399039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] PATH_INFO: `/v3/system/users/40a56b2a275f4d8287fe2c99a8d0644e/roles/45c36965457d4c4e93c0f7bc2b98fad9` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:07.401626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=40a56b2a275f4d8287fe2c99a8d0644e, role_id=45c36965457d4c4e93c0f7bc2b98fad9)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:07.403255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:07.469739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 163/331] 10.222.0.45 () {58 vars in 1334 bytes} [Thu Aug 25 04:53:07 2022] PUT /identity/v3/system/users/40a56b2a275f4d8287fe2c99a8d0644e/roles/45c36965457d4c4e93c0f7bc2b98fad9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:53:07.511437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783d2a-e487-4fbf-97e7-eb99cac69677 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:07.551716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:07.552289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:07.552565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:07.552835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:07.554230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:07.554843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:07.557153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:07.568334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 169/332] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:07.574424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:07.698842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6dc98-0ef0-4550-ad2f-108ae975fd0c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:07.716438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:07.743000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3deac6-9bab-4c38-8d37-d0e67b173707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:07.743683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3deac6-9bab-4c38-8d37-d0e67b173707 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:07.744000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3deac6-9bab-4c38-8d37-d0e67b173707 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:07.744283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3deac6-9bab-4c38-8d37-d0e67b173707 None admin] PATH_INFO: `/v3/users/ea0d03bf54084f818f1ce5e0eb6ee317` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:07.746388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3deac6-9bab-4c38-8d37-d0e67b173707 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0d03bf54084f818f1ce5e0eb6ee317)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:07.747850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3deac6-9bab-4c38-8d37-d0e67b173707 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:07.749810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 164/333] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:07 2022] GET /identity/v3/users/ea0d03bf54084f818f1ce5e0eb6ee317 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:07.756323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:07.810641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:07.877574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b365e-c62e-47be-b4d5-8bae59bd5aa2 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:07.913672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc63061-fada-468f-ba87-21d021821786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:07.914491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc63061-fada-468f-ba87-21d021821786 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:07.914808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc63061-fada-468f-ba87-21d021821786 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:07.915038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc63061-fada-468f-ba87-21d021821786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:07.915781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc63061-fada-468f-ba87-21d021821786 None admin] RBAC: Adding query filter params (role.id=e305aaac48e64ec7ae700613e1672700, user.id=ea0d03bf54084f818f1ce5e0eb6ee317, scope.system=all) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:07.916114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc63061-fada-468f-ba87-21d021821786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:07.917576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc63061-fada-468f-ba87-21d021821786 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:07.931983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 170/334] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 25 04:53:07 2022] GET /identity/v3/role_assignments?user.id=ea0d03bf54084f818f1ce5e0eb6ee317&scope.system=all&role.id=e305aaac48e64ec7ae700613e1672700 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:09.015655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e8652-36c4-47b6-8344-d16b5eded544 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:09.016222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e8652-36c4-47b6-8344-d16b5eded544 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:09.016222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e8652-36c4-47b6-8344-d16b5eded544 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:09.017651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 165/335] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:09.023622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe410b2-0907-4998-a6cf-49c523d5a312 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:09.024071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe410b2-0907-4998-a6cf-49c523d5a312 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:09.024166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe410b2-0907-4998-a6cf-49c523d5a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:09.048040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-abe410b2-0907-4998-a6cf-49c523d5a312 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:09.049227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-abe410b2-0907-4998-a6cf-49c523d5a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:09.142208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 171/336] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:09.496854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524ed9-e160-4a6b-b4c6-c0721235ea56 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:09.497228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524ed9-e160-4a6b-b4c6-c0721235ea56 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:09.497421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524ed9-e160-4a6b-b4c6-c0721235ea56 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:09.498963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 166/337] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:09.504379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0431-23b9-461e-a71f-016bcc930709 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:09.504662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0431-23b9-461e-a71f-016bcc930709 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:09.504932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0431-23b9-461e-a71f-016bcc930709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:09.532883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-566d0431-23b9-461e-a71f-016bcc930709 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:09.534086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-566d0431-23b9-461e-a71f-016bcc930709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:09.580302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:09.625489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524ed9-e160-4a6b-b4c6-c0721235ea56 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:09.645657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 172/338] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:09.754378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ab16-08f1-49fc-b1e6-38d01d75cbfc None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:09.754791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ab16-08f1-49fc-b1e6-38d01d75cbfc None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:09.755285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1ab16-08f1-49fc-b1e6-38d01d75cbfc None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:09.768137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 173/339] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:09 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:09.769801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9ca5-603d-4bcf-821e-a8537646368e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:09.770081 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9ca5-603d-4bcf-821e-a8537646368e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:09.770354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9ca5-603d-4bcf-821e-a8537646368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:09.805098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3abd9ca5-603d-4bcf-821e-a8537646368e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:09.806308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3abd9ca5-603d-4bcf-821e-a8537646368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:09.813230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524ed9-e160-4a6b-b4c6-c0721235ea56 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:09.895456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:09.896280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:09.896562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:09.897971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:09.920521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:09.925311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:09.926198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:09.927000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 167/340] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:09.933792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:09.937029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 174/341] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:09.984844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:10.050795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd13e88-5a0b-4a79-abc1-9e1e8db3b299 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:10.092464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:10.093330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:10.093838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:10.094331 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:10.095213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:10.095522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:10.100536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:10.111580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 168/342] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:10.118495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd9ca5-603d-4bcf-821e-a8537646368e None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:10.219436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:10.236336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd9ca5-603d-4bcf-821e-a8537646368e None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:10.278940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:10.279567 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:10.279849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:10.280154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:10.309679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:10.394792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:10.396293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:10.511413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba4c5-f12d-4728-8008-4b37750a1c77 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:10.517935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:10.519021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:10.548387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 175/343] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:10.549311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:10.558155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:10.559149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:10.559656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:10.568590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:10.572377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:10.577418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:10.578368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:10.579181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:10.581142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 169/344] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:53:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:10.585208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:10.712437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379d711-99f6-4dab-8ee1-c87150f00a98 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:10.753741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:10.754926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:10.755401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:10.755865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:10.758390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:10.760214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:10.762110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 170/345] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:10 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:10.763188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:10.778241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96577beb-3486-40f7-bf15-451965e27d24 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:10.804948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:10.823240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:10.824283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:10.824802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:10.825280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:10.840433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:10.846706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:10.847690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:10.849405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 176/346] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:10.850117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:10.891941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1f8a5-d2d7-4aa1-8833-f27353d8fdf0 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:10.914314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:10.940357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829bc33-0963-4266-886e-7bfe90505cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:10.941806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829bc33-0963-4266-886e-7bfe90505cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:10.942289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829bc33-0963-4266-886e-7bfe90505cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:10.942797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829bc33-0963-4266-886e-7bfe90505cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:10.944675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829bc33-0963-4266-886e-7bfe90505cd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:10.945271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829bc33-0963-4266-886e-7bfe90505cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:10.948459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829bc33-0963-4266-886e-7bfe90505cd3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:10.959995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 171/347] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:10.961604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f497-64e8-40ed-85f8-43fddab2172d None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:10.962097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f497-64e8-40ed-85f8-43fddab2172d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:10.962565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f497-64e8-40ed-85f8-43fddab2172d None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:10.964461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 172/348] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:10.965780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0f497-64e8-40ed-85f8-43fddab2172d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:10.980606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d03fd4-6b4c-461f-a6f5-e28f0cd49e3c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:11.023596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3465950-5b6c-4a19-b6b5-2cae5ff7d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:11.024072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465950-5b6c-4a19-b6b5-2cae5ff7d8be None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.024351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465950-5b6c-4a19-b6b5-2cae5ff7d8be None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.024624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465950-5b6c-4a19-b6b5-2cae5ff7d8be None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.030801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3465950-5b6c-4a19-b6b5-2cae5ff7d8be None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:11.034148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3465950-5b6c-4a19-b6b5-2cae5ff7d8be None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:11.036182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 177/349] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:10 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:11.037495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ef20-7d43-4a58-ae30-903cb6f9e749 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.037820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ef20-7d43-4a58-ae30-903cb6f9e749 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.038092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ef20-7d43-4a58-ae30-903cb6f9e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.059801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5527ef20-7d43-4a58-ae30-903cb6f9e749 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:11.061039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5527ef20-7d43-4a58-ae30-903cb6f9e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:11.094477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:11.109879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0f497-64e8-40ed-85f8-43fddab2172d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:11.149553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:11.150159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.150437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.150707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.151378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:11.151680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:11.153121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:11.156068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 178/350] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:11.157524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ef20-7d43-4a58-ae30-903cb6f9e749 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:11.170106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 173/351] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:11.171026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:11.212424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:11.285451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ef20-7d43-4a58-ae30-903cb6f9e749 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:11.312173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79868db7-6172-4103-b1ef-ba9fb397ee6d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:11.336640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a74f8-5990-4738-bb15-c4b4e5c671e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:11.338178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a74f8-5990-4738-bb15-c4b4e5c671e5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.338821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a74f8-5990-4738-bb15-c4b4e5c671e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.339288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a74f8-5990-4738-bb15-c4b4e5c671e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.354295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:11.354836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.355113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.355384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.356198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=83c883f6c4b74c0281aa45208ab7de42) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:11.356701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:11.357974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:11.364322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 174/352] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:11 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=e305aaac48e64ec7ae700613e1672700 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:11.365133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:11.393146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:11.441571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a74f8-5990-4738-bb15-c4b4e5c671e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:11.444612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a74f8-5990-4738-bb15-c4b4e5c671e5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:11.501973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749379f-03e8-4deb-a5b5-cf27b0dacf9b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:11.505597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:11.545728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e13868-96e2-412e-84a4-8685e10760e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:11.546649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13868-96e2-412e-84a4-8685e10760e1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.547072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13868-96e2-412e-84a4-8685e10760e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.547561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e13868-96e2-412e-84a4-8685e10760e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.575156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 179/353] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:11.576540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad543267-2738-4e12-8776-c41110ece0bd None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.576822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad543267-2738-4e12-8776-c41110ece0bd None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.577092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad543267-2738-4e12-8776-c41110ece0bd None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.581907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 180/354] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:11.581907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad543267-2738-4e12-8776-c41110ece0bd None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:11.640755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13868-96e2-412e-84a4-8685e10760e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:11.642142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e13868-96e2-412e-84a4-8685e10760e1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:11.676135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:11.729656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad543267-2738-4e12-8776-c41110ece0bd None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:11.776203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:11.777031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.777306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.777577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.786748 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 175/355] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:11.788137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ea18-d4c9-4aec-8961-d065a5a7e2c4 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.788920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ea18-d4c9-4aec-8961-d065a5a7e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.788920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ea18-d4c9-4aec-8961-d065a5a7e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.800264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:11.807136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:11.808118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 04:53:11.808937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:11.810705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a698ea18-d4c9-4aec-8961-d065a5a7e2c4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:11.811924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a698ea18-d4c9-4aec-8961-d065a5a7e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:11.813448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 181/356] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:11.815395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:11.817753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:11.904743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 176/357] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:11.911274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79b6d-dc9a-404b-8b9f-0aea0cd26dd1 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:11.911644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79b6d-dc9a-404b-8b9f-0aea0cd26dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:11.912023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79b6d-dc9a-404b-8b9f-0aea0cd26dd1 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:11.915489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 177/358] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:11.916167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b79b6d-dc9a-404b-8b9f-0aea0cd26dd1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:11.945198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e758d8-873b-41e9-ac7f-bce7196de40d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:11.983390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:11.999755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.001219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.002250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.003040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.004616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.007156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.010474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 182/359] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:11 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.011705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.051146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b79b6d-dc9a-404b-8b9f-0aea0cd26dd1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.090183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65fb97-6d4c-40ad-a7d1-968c6813e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.090823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fb97-6d4c-40ad-a7d1-968c6813e3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.091098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fb97-6d4c-40ad-a7d1-968c6813e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.091368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65fb97-6d4c-40ad-a7d1-968c6813e3f5 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.092528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65fb97-6d4c-40ad-a7d1-968c6813e3f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.093978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65fb97-6d4c-40ad-a7d1-968c6813e3f5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.095776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 178/360] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:11 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.102838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035afdb1-9858-41c3-a6b7-e1eb690546ad None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.103122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035afdb1-9858-41c3-a6b7-e1eb690546ad None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.103384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035afdb1-9858-41c3-a6b7-e1eb690546ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.110299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:12.124438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-035afdb1-9858-41c3-a6b7-e1eb690546ad None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:12.125695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-035afdb1-9858-41c3-a6b7-e1eb690546ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:12.153622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07210d-28d2-43b2-96f6-8275f153adbe None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.193775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.194929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.195176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.195337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.196024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:12.196334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.197715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.209203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 183/361] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.210193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.211183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 179/362] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:12.212265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035afdb1-9858-41c3-a6b7-e1eb690546ad None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.266959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:12.343827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035afdb1-9858-41c3-a6b7-e1eb690546ad None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.367841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d705e-b77d-45ac-ae1b-73ba3df8be00 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.383063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.384048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.384533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.385029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.386366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.388056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.389888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 180/363] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.390893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.402478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:12.408073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.408842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.409021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.409242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.410528 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.412070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.414372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 184/364] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.415134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.502550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fbad6-7038-4f6a-856d-875e18e54bce None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.521250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:12.523494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6fc34a-96ad-4195-8360-b2f3ff84dcc9 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.541204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.542181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.542664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.543198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] PATH_INFO: `/v3/users/40a56b2a275f4d8287fe2c99a8d0644e` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.544648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=40a56b2a275f4d8287fe2c99a8d0644e)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.547387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.549300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 181/365] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/users/40a56b2a275f4d8287fe2c99a8d0644e => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.550320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.566526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.567163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.568693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.568693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.581575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:12.588592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:12.589704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:12.590704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:12.592644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 185/366] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:12.593811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.669517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:12.681105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a90cf-5085-4100-aeda-48cc5d9f0cc8 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.727370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5de35-6054-4f61-ba05-991b6c0c6135 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.730560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.731173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.731447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.731714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.732474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=7930d95e9a4040bda3c164f09a0f510a) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:12.732780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.734208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.741694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 182/367] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=e305aaac48e64ec7ae700613e1672700 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.742594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.772693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.773676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.774259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.774736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.775924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=83c883f6c4b74c0281aa45208ab7de42) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:12.776455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.778251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.785631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 186/368] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.787049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.815066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:12.897741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa48e5-8199-414b-86d4-dd935ced2cb7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.916343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e7545-ef5d-40a2-b958-0b72934fdbf0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:12.946112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.946745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.947022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.947288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.948077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] RBAC: Adding query filter params (role.id=45c36965457d4c4e93c0f7bc2b98fad9, user.id=40a56b2a275f4d8287fe2c99a8d0644e, scope.system=all) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:12.948381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:12.950207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:12.961414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:12.969598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 183/369] 10.222.0.45 () {56 vars in 1308 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/role_assignments?user.id=40a56b2a275f4d8287fe2c99a8d0644e&scope.system=all&role.id=45c36965457d4c4e93c0f7bc2b98fad9 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:12.970965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:12.982825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:12.983781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:12.984100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:12.984373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:12.999683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:13.011003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:13.012051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:13.013141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 187/370] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:13.024057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:13.208863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1c947-80ff-4b82-bb9b-fd48c677110a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:13.219627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:13.235493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d880d-41ab-4a9c-938c-d56e52dd8658 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:13.279252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:13.279780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:13.280078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:13.280345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:13.281008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:13.281308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:13.282690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:13.299029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 184/371] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:13.301077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:13.301680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:13.301952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:13.302238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:13.302886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:13.303184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:13.305489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:13.306670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:13.324992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 188/372] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:13.332174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:13.417698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:13.503985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bee36e-583e-463e-a6bb-880fdd61f64f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:13.518310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477aa30d-5ee7-46aa-881a-b8085f535bd6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:13.570963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:13.571504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:13.571772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:13.572066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:13.581802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b6536-7c66-4dc9-b7d8-48465fae1a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:13.584297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6536-7c66-4dc9-b7d8-48465fae1a1f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:13.585163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6536-7c66-4dc9-b7d8-48465fae1a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:13.585506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b6536-7c66-4dc9-b7d8-48465fae1a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:13.628867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:13.700587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:13.702059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:13.718400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6536-7c66-4dc9-b7d8-48465fae1a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:13.720701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b6536-7c66-4dc9-b7d8-48465fae1a1f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:13.781284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:13.855063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 185/373] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:13.855248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 189/374] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:13.860846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:13.861010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45220083-e6e5-4a96-9ce5-f4a7ec612df4 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:13.861387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45220083-e6e5-4a96-9ce5-f4a7ec612df4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:13.861870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45220083-e6e5-4a96-9ce5-f4a7ec612df4 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:13.864285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 190/375] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:13.866950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45220083-e6e5-4a96-9ce5-f4a7ec612df4 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:13.961487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:14.003343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0823e-86a7-4d8d-957f-0215c29df9d2 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:14.009889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45220083-e6e5-4a96-9ce5-f4a7ec612df4 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:14.048759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c56e19-2ef9-461d-bad6-0c913a6e6b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:14.049731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c56e19-2ef9-461d-bad6-0c913a6e6b6f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.050008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c56e19-2ef9-461d-bad6-0c913a6e6b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.050551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c56e19-2ef9-461d-bad6-0c913a6e6b6f None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.051852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c56e19-2ef9-461d-bad6-0c913a6e6b6f None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:14.054622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c56e19-2ef9-461d-bad6-0c913a6e6b6f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:14.056272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 186/376] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:13 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:14.057427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e54757-795a-4e24-a4b1-f3972182e23d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.057687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e54757-795a-4e24-a4b1-f3972182e23d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.058019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e54757-795a-4e24-a4b1-f3972182e23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.059169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:14.059805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.060176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.060452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] PATH_INFO: `/v3/projects/1aab57a271ef4e04a301d0c13f37422d` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.061600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=1aab57a271ef4e04a301d0c13f37422d)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:14.063116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:14.065216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 191/377] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:13 2022] GET /identity/v3/projects/1aab57a271ef4e04a301d0c13f37422d => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:14.067972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:14.083121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-77e54757-795a-4e24-a4b1-f3972182e23d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:14.085196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-77e54757-795a-4e24-a4b1-f3972182e23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:14.085443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:14.187005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 187/378] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:14.188441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e54757-795a-4e24-a4b1-f3972182e23d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:14.201820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c0862-aade-4fde-915e-087bc1f02bc0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:14.281190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:14.281946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.282293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.282634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.288355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:14.288797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:14.290211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:14.292269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 192/379] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:14 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:14.298284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:14.361697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e54757-795a-4e24-a4b1-f3972182e23d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:14.409623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:14.410260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.410536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.410803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] PATH_INFO: `/v3/groups/10cb187527714f73adb5ef8227d9101b` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.420789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] RBAC: Authorizing `identity:get_group(group_id=10cb187527714f73adb5ef8227d9101b)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:14.422243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:14.423875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 188/380] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:14 2022] GET /identity/v3/groups/10cb187527714f73adb5ef8227d9101b => generated 229 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:14.431049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:14.435103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:14.486900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c595384-df7e-4f71-8213-f550f392b3e4 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:14.549027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:14.549632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.549903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.550169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.550902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=7930d95e9a4040bda3c164f09a0f510a) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:14.551202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:14.552723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:14.562187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 193/381] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:14 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:14.565232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:14.596219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c5da4-b1a3-478a-a09a-2cf1494b6bd0 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:14.640813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:14.654445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:14.665925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.665925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.665925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.665925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] RBAC: Adding query filter params (group.id=10cb187527714f73adb5ef8227d9101b, role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=1aab57a271ef4e04a301d0c13f37422d) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:14.665925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:14.665925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:14.669755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 189/382] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:14 2022] GET /identity/v3/role_assignments?group.id=10cb187527714f73adb5ef8227d9101b&scope.project.id=1aab57a271ef4e04a301d0c13f37422d&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:14.746075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0151f7-c8c8-4418-8ede-29de850a168b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:14.799591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:14.800263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:14.800542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:14.800822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:14.822321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:14.830731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:14.831761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:14.832670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 194/383] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:14.841175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:14.976377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f83cd-9b03-4bf0-a171-56b7d66de074 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:15.022220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26227fb5-940b-45a1-8e68-0438150201eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:15.023223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26227fb5-940b-45a1-8e68-0438150201eb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.023779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26227fb5-940b-45a1-8e68-0438150201eb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.024298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26227fb5-940b-45a1-8e68-0438150201eb None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.025188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26227fb5-940b-45a1-8e68-0438150201eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:15.025714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26227fb5-940b-45a1-8e68-0438150201eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:15.027375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26227fb5-940b-45a1-8e68-0438150201eb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:15.040285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 190/384] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:15.046085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:15.061070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:15.180521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132182a-8476-4e15-a1db-4785ad8cc8bf None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:15.224300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:15.224943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.225764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.226264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.227478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:15.229990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d528a50-3a9d-4f1d-9b19-28c3cb1eb25d None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.230273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d528a50-3a9d-4f1d-9b19-28c3cb1eb25d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.230549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d528a50-3a9d-4f1d-9b19-28c3cb1eb25d None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.231935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 191/385] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:53:15.232616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:15.234526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 195/386] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:15 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:15.239145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f303ea-1f81-4eec-97c9-433f125a94a1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.239483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:15.239586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f303ea-1f81-4eec-97c9-433f125a94a1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.239978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f303ea-1f81-4eec-97c9-433f125a94a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.289105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-22f303ea-1f81-4eec-97c9-433f125a94a1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:15.290620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-22f303ea-1f81-4eec-97c9-433f125a94a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:15.340090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:15.367623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3104-b4c2-43e7-9848-800d3516f646 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:15.411086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:15.411727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.412034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.412364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.414544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:15.414665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:15.416145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:15.417817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 196/387] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:15 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:15.424227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:15.445717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 192/388] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:15.479431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea730b2-5dcd-4c38-8ebe-8eaf6caf5543 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.479852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea730b2-5dcd-4c38-8ebe-8eaf6caf5543 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.480258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea730b2-5dcd-4c38-8ebe-8eaf6caf5543 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.481830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 193/389] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:53:15.488011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ee48-0ba9-4539-a957-a3c649fcfec2 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.488405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ee48-0ba9-4539-a957-a3c649fcfec2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.488775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5ee48-0ba9-4539-a957-a3c649fcfec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.526929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-73a5ee48-0ba9-4539-a957-a3c649fcfec2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:15.528190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-73a5ee48-0ba9-4539-a957-a3c649fcfec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:15.546551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406c234-5e49-4a58-b16c-675412be15de None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:15.590575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:15.591504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.591975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.592512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42/groups/509dd68c562a46219d51e25249b0c887/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.594880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=83c883f6c4b74c0281aa45208ab7de42, group_id=509dd68c562a46219d51e25249b0c887, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:15.596497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:15.665277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 194/390] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:15.682833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 197/391] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 25 04:53:15 2022] PUT /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42/groups/509dd68c562a46219d51e25249b0c887/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:15.804599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5ee48-0ba9-4539-a957-a3c649fcfec2 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:15.919604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5ee48-0ba9-4539-a957-a3c649fcfec2 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:15.939280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:15.960244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:15.960944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:15.961222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:15.961495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:15.973529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:15.982630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:15.983612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:15.984476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:15.985089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 195/392] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:15.992845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:15.997111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:15.997414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:16.125752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ffee-81ef-4036-a19a-22e3cb8e4310 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.144219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898160a-7ad2-4d88-86f6-baac691f21b4 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.172669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.173296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.173574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.173960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.174643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:16.174946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:16.176362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:16.186889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 196/393] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:16.191950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:16.195044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.196022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.196592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.197047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.210480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:16.216286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:16.217217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:16.218052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:16.220637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 198/394] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:53:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:16.227102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:16.236531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:16.301968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:16.309882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed246b-46aa-4498-8293-83a13cd24956 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.354999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.355926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.356382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.356818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.358785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:16.361699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:16.366486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 197/395] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:16 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:16.371033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:16.385169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67593af1-696c-4e32-aec2-c386d371f4aa None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.455657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.456335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.456616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.456891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.457577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:16.457882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:16.459276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:16.479652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 199/396] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:16.485581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:16.583559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340e447-b572-4b02-a89c-b4fdb0634e4a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.603028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:16.651291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa09920-2980-40dd-aca5-9d729410322f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.665767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.666826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.667571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.668146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.669558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:16.671389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:16.673646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 198/397] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:16 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:16.679726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:16.709224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:16.730982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275903e-960b-4abb-989c-d331353a086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.731628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275903e-960b-4abb-989c-d331353a086e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.739997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275903e-960b-4abb-989c-d331353a086e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.739997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275903e-960b-4abb-989c-d331353a086e None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.739997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275903e-960b-4abb-989c-d331353a086e None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:16.739997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275903e-960b-4abb-989c-d331353a086e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:16.739997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 200/398] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:16 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:16.743606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275903e-960b-4abb-989c-d331353a086e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:16.851300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30b0d3-fa5a-4db1-a5c8-14703c01b060 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.863795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275903e-960b-4abb-989c-d331353a086e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:16.908278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecf994-d78d-4c46-8472-3aa3a56283b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.909232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf994-d78d-4c46-8472-3aa3a56283b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.909814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf994-d78d-4c46-8472-3aa3a56283b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.910263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecf994-d78d-4c46-8472-3aa3a56283b4 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a/groups/509dd68c562a46219d51e25249b0c887/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.911291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:16.911966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:16.912257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:16.912598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:16.913231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf994-d78d-4c46-8472-3aa3a56283b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7930d95e9a4040bda3c164f09a0f510a, group_id=509dd68c562a46219d51e25249b0c887, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:16.914980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecf994-d78d-4c46-8472-3aa3a56283b4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:16.916660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:16.918146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:16.920471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 201/399] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:16 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:16.926707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:17.009179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 199/400] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 25 04:53:16 2022] PUT /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a/groups/509dd68c562a46219d51e25249b0c887/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:17.018392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:17.064494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecac57d-3225-4907-ab2a-fd9b9846ae0f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:17.106940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46062b1-d97f-43b8-9241-4bb44a12db2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:17.107940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46062b1-d97f-43b8-9241-4bb44a12db2d None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:17.108412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46062b1-d97f-43b8-9241-4bb44a12db2d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:17.108861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46062b1-d97f-43b8-9241-4bb44a12db2d None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42/groups/509dd68c562a46219d51e25249b0c887/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:17.111351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46062b1-d97f-43b8-9241-4bb44a12db2d None admin] RBAC: Authorizing `identity:create_grant(project_id=83c883f6c4b74c0281aa45208ab7de42, group_id=509dd68c562a46219d51e25249b0c887, role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:17.113071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46062b1-d97f-43b8-9241-4bb44a12db2d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:17.197322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 202/401] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 25 04:53:16 2022] PUT /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42/groups/509dd68c562a46219d51e25249b0c887/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:53:17.211759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696af9-0339-4225-b2d5-306e863a1cb9 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:17.212390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696af9-0339-4225-b2d5-306e863a1cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:17.212869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e696af9-0339-4225-b2d5-306e863a1cb9 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:17.214844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 200/402] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:17.222153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794efc-34e6-4cc1-94f1-30cf8f734e56 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:17.222736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794efc-34e6-4cc1-94f1-30cf8f734e56 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:17.223256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794efc-34e6-4cc1-94f1-30cf8f734e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:17.250389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f7794efc-34e6-4cc1-94f1-30cf8f734e56 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:17.252037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f7794efc-34e6-4cc1-94f1-30cf8f734e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:17.337690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 203/403] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:17.461283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c695-8134-42a0-abd3-1fa99fe59420 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:17.462187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c695-8134-42a0-abd3-1fa99fe59420 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:17.462661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21c695-8134-42a0-abd3-1fa99fe59420 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:17.464370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 201/404] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:17.469877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edc6a-d6cf-48e2-9304-7972c1a8b619 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:17.470342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edc6a-d6cf-48e2-9304-7972c1a8b619 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:17.470424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edc6a-d6cf-48e2-9304-7972c1a8b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:17.494272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-017edc6a-d6cf-48e2-9304-7972c1a8b619 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:17.495514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-017edc6a-d6cf-48e2-9304-7972c1a8b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:17.555265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:17.591266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 204/405] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:17.641104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21c695-8134-42a0-abd3-1fa99fe59420 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:17.705867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:17.794920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21c695-8134-42a0-abd3-1fa99fe59420 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:17.832360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:17.833359 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:17.833870 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:17.834439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:17.845422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:17.850745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:17.851636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:17.852474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:17.860053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 202/406] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:53:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:17.862731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017edc6a-d6cf-48e2-9304-7972c1a8b619 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:17.891121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.006310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:18.018930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017edc6a-d6cf-48e2-9304-7972c1a8b619 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.020916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4830b3-0e36-431f-b555-4bc3a39826e1 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.071534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.072110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.072387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.072679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.075858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.076717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.077213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.077700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.078582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:18.079089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.080706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:18.090180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:18.091232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:18.092293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 203/407] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:18.096381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.103869 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 205/408] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:18.109389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.205430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:18.234013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd50de-c021-4e4c-a632-15bfc3eb0319 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.271666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.273245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.273724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.274180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.275018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:18.275489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.277049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.286003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 204/409] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:18.296860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.314406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298097f-79f3-43c8-a9ee-a3eb767ec94f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.332013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:18.363064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.363755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.364064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.364341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.365502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.367721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.376381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 206/410] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:18 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:18.381490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.423154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2153d13-bc28-40c3-bb36-6b42b16808b5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.460315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.461247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.461725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.462596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] PATH_INFO: `/v3/groups/10cb187527714f73adb5ef8227d9101b` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.463980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] RBAC: Authorizing `identity:get_group(group_id=10cb187527714f73adb5ef8227d9101b)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.465616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.467412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 205/411] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:18 2022] GET /identity/v3/groups/10cb187527714f73adb5ef8227d9101b => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:18.475738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.554252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42540c94-2e46-4090-b62e-3cda6cb9086b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.580088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:18.584821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:18.597699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84e6c0-d47c-4721-8dae-45bdeebbaa2d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.625637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.626294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.626574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.626846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.628077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.629657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.632256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 207/412] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:18 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:18.638093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.638954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.639401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.639842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] PATH_INFO: `/v3/projects/1aab57a271ef4e04a301d0c13f37422d` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.640875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.641520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] RBAC: Authorizing `identity:get_project(project_id=1aab57a271ef4e04a301d0c13f37422d)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.643150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.650514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 206/413] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:18 2022] GET /identity/v3/projects/1aab57a271ef4e04a301d0c13f37422d => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:18.652902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:18.757723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9e88-6ec2-444c-b07b-3ed039f42bdb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.774993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285d4bf-3e87-41b5-ae06-cdb5d07e7e60 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:18.796622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61141c5f-3799-44fa-9e4d-34db9c3ce09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.797292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141c5f-3799-44fa-9e4d-34db9c3ce09a None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.797575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141c5f-3799-44fa-9e4d-34db9c3ce09a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.797855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141c5f-3799-44fa-9e4d-34db9c3ce09a None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a/groups/509dd68c562a46219d51e25249b0c887/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.800340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61141c5f-3799-44fa-9e4d-34db9c3ce09a None admin] RBAC: Authorizing `identity:create_grant(project_id=7930d95e9a4040bda3c164f09a0f510a, group_id=509dd68c562a46219d51e25249b0c887, role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.802847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61141c5f-3799-44fa-9e4d-34db9c3ce09a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.815673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c75ff-b8ac-4601-bfdf-82c3cada41e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:18.826503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c75ff-b8ac-4601-bfdf-82c3cada41e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.826503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c75ff-b8ac-4601-bfdf-82c3cada41e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.826503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c75ff-b8ac-4601-bfdf-82c3cada41e1 None admin] PATH_INFO: `/v3/projects/1aab57a271ef4e04a301d0c13f37422d/groups/10cb187527714f73adb5ef8227d9101b/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.826503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c75ff-b8ac-4601-bfdf-82c3cada41e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1aab57a271ef4e04a301d0c13f37422d, group_id=10cb187527714f73adb5ef8227d9101b, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:18.826503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c75ff-b8ac-4601-bfdf-82c3cada41e1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:18.920024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 208/414] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 25 04:53:18 2022] PUT /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a/groups/509dd68c562a46219d51e25249b0c887/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:18.920024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1e0b9-47fb-4ae1-ab9f-69c4234d8599 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.920024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1e0b9-47fb-4ae1-ab9f-69c4234d8599 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.920024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1e0b9-47fb-4ae1-ab9f-69c4234d8599 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.920586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 209/415] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:18.932041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 207/416] 10.222.0.45 () {58 vars in 1442 bytes} [Thu Aug 25 04:53:18 2022] PUT /identity/v3/projects/1aab57a271ef4e04a301d0c13f37422d/groups/10cb187527714f73adb5ef8227d9101b/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:53:18.932786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3289f-d1b1-4964-891e-7e9025396a67 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:18.933168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3289f-d1b1-4964-891e-7e9025396a67 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:18.933397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3289f-d1b1-4964-891e-7e9025396a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:18.954394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-60f3289f-d1b1-4964-891e-7e9025396a67 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:18.955727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-60f3289f-d1b1-4964-891e-7e9025396a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:18.997104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:19.047927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 210/417] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:19.358259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5c05-90e5-4d17-8583-2956838360b9 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:19.358735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5c05-90e5-4d17-8583-2956838360b9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:19.359211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5c05-90e5-4d17-8583-2956838360b9 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:19.361682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 208/418] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:19.368235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450fca-4004-4b65-b8e6-6ea79b375f3f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:19.368776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450fca-4004-4b65-b8e6-6ea79b375f3f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:19.369212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450fca-4004-4b65-b8e6-6ea79b375f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:19.396669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e3450fca-4004-4b65-b8e6-6ea79b375f3f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:19.398077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e3450fca-4004-4b65-b8e6-6ea79b375f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:19.464265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac5c05-90e5-4d17-8583-2956838360b9 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:19.495210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 211/419] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:19.501864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:19.667282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac5c05-90e5-4d17-8583-2956838360b9 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:19.749809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:19.750498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:19.750995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:19.751491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:19.785595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:19.791571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:19.792515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:19.793325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 209/420] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:19.801787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450fca-4004-4b65-b8e6-6ea79b375f3f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:19.833642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:19.951458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:19.955737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450fca-4004-4b65-b8e6-6ea79b375f3f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:19.964345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:19.993224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f596b7a-88ac-4154-8fb5-fb4f6db9f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:19.993969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596b7a-88ac-4154-8fb5-fb4f6db9f13a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:19.994164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596b7a-88ac-4154-8fb5-fb4f6db9f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:19.994429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596b7a-88ac-4154-8fb5-fb4f6db9f13a None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:19.996224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f596b7a-88ac-4154-8fb5-fb4f6db9f13a None admin] RBAC: Adding query filter params (name=member) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:19.996550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f596b7a-88ac-4154-8fb5-fb4f6db9f13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:19.997954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f596b7a-88ac-4154-8fb5-fb4f6db9f13a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:20.005161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9ea3-8e5d-4dfb-b8a3-fdca6f9c62ac None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.007777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 212/421] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:20.009272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842847e1-50b8-4fcc-82ba-4b99ed6aab5a None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.009406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842847e1-50b8-4fcc-82ba-4b99ed6aab5a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.009703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842847e1-50b8-4fcc-82ba-4b99ed6aab5a None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.011882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 213/422] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:20.016309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842847e1-50b8-4fcc-82ba-4b99ed6aab5a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.048708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f74a94-2f2f-4b1c-8118-95dc0541000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.049582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f74a94-2f2f-4b1c-8118-95dc0541000d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.050056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f74a94-2f2f-4b1c-8118-95dc0541000d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.050490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f74a94-2f2f-4b1c-8118-95dc0541000d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.063864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f74a94-2f2f-4b1c-8118-95dc0541000d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-59f74a94-2f2f-4b1c-8118-95dc0541000d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:20.072992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:20.073918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 04:53:20.074732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:20.077292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 210/423] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:20.078667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaff9e-a36c-4cdb-bba8-df5556a49f03 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.079141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaff9e-a36c-4cdb-bba8-df5556a49f03 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.079605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaff9e-a36c-4cdb-bba8-df5556a49f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.097950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-49aaff9e-a36c-4cdb-bba8-df5556a49f03 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:20.099742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-49aaff9e-a36c-4cdb-bba8-df5556a49f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:20.141206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842847e1-50b8-4fcc-82ba-4b99ed6aab5a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.170579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 211/424] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:20.171838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaff9e-a36c-4cdb-bba8-df5556a49f03 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.178963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.179550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.179824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.180135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.210436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:20.237523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:20.254389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:20.255940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:20.280775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaff9e-a36c-4cdb-bba8-df5556a49f03 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.317275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.318233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.318772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.319240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.320277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] RBAC: Adding query filter params (name=member) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:20.320775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:20.322440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:20.331376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 212/425] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:20.346456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.374192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 214/426] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:20.378695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.486460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:20.531185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787e2a9-8df7-49df-8781-d148ded72794 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.544136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3aae-7c02-42bc-bc58-410bf47b1a64 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.566331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.566826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.567102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.567366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.568523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:20.570481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:20.571808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:20.572594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 215/427] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:20.573189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.584437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.585534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.586033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.586556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.658324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:20.660149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:20.678703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe47c86-5f50-4cb0-8d76-a606f96368f8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.708308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:20.716574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.717337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.717614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.717886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.733082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:20.739360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:20.740273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 216/428] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:20.741330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.787021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 213/429] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:20.788458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.814267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:20.865301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6588d33-af5b-4df9-bbb8-4dcf33e19358 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.895198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f662f7-35ea-4968-9e36-2f2e642ff1a1 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:20.909352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.909980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.910393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.910681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.912181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:20.913866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:20.920221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 217/430] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:20.920221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.949861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:20.951143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:20.951791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:20.952292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:20.953698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:20.954213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:20.956551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:20.967899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 214/431] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:20.969106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:20.991750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:21.040681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a301d-a7ba-40f4-976d-88b5efb6e617 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:21.078092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:21.082392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:21.083565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.083940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.084984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.086644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:21.088714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:21.091238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 218/432] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:21.092416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:21.098050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1942-c804-4246-bc42-5d2082e52063 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:21.136876 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:21.137809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.138266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.138727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.139687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=83c883f6c4b74c0281aa45208ab7de42) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:21.140270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:21.142077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:21.149237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 215/433] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:20 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=e305aaac48e64ec7ae700613e1672700 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:21.150343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:21.245564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c185fbe-a839-4e96-a42b-4fc843885f39 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:21.279621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:21.312703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1fc88-e28f-4fbc-ad86-164098bada2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:21.313451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fc88-e28f-4fbc-ad86-164098bada2b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.313740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fc88-e28f-4fbc-ad86-164098bada2b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.314019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1fc88-e28f-4fbc-ad86-164098bada2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.344798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8a69-028c-486b-afc1-6e9ee2e1712d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:21.403681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65821214-f4fe-4367-978c-5ac515886c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:21.404375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821214-f4fe-4367-978c-5ac515886c18 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.405081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821214-f4fe-4367-978c-5ac515886c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.405081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65821214-f4fe-4367-978c-5ac515886c18 None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.406059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821214-f4fe-4367-978c-5ac515886c18 None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:21.407510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65821214-f4fe-4367-978c-5ac515886c18 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:21.414374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 216/434] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:21 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:21.414374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde72c-0b55-478b-88ab-6e9a45bb89c3 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.414374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde72c-0b55-478b-88ab-6e9a45bb89c3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.414374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cde72c-0b55-478b-88ab-6e9a45bb89c3 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.414374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 217/435] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:21.414374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209c0a6-8241-44ad-9b93-74a83f97c9b8 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.416749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209c0a6-8241-44ad-9b93-74a83f97c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.416749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209c0a6-8241-44ad-9b93-74a83f97c9b8 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.416749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 218/436] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:21.416749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209c0a6-8241-44ad-9b93-74a83f97c9b8 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:21.423845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1fc88-e28f-4fbc-ad86-164098bada2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:21.425363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f1fc88-e28f-4fbc-ad86-164098bada2b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:21.438534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:21.536380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209c0a6-8241-44ad-9b93-74a83f97c9b8 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:21.539622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 219/437] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:21.541045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87768-3463-44db-ad20-532f08988ff1 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.541334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87768-3463-44db-ad20-532f08988ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.541607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e87768-3463-44db-ad20-532f08988ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.562410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-20e87768-3463-44db-ad20-532f08988ff1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:21.563600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-20e87768-3463-44db-ad20-532f08988ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:21.582300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440dbed-fd2a-4eaa-a373-099feb78e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:21.582929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440dbed-fd2a-4eaa-a373-099feb78e1dd None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.583197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440dbed-fd2a-4eaa-a373-099feb78e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.583473 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440dbed-fd2a-4eaa-a373-099feb78e1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.584879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440dbed-fd2a-4eaa-a373-099feb78e1dd None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=e305aaac48e64ec7ae700613e1672700, scope.project.id=7930d95e9a4040bda3c164f09a0f510a) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:21.585396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440dbed-fd2a-4eaa-a373-099feb78e1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:21.585722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:21.587083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440dbed-fd2a-4eaa-a373-099feb78e1dd None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:21.593542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 219/438] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:21 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=e305aaac48e64ec7ae700613e1672700 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:21.594749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be26a-a8de-44b5-9ca6-40a3c86b6e68 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.595040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be26a-a8de-44b5-9ca6-40a3c86b6e68 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.595316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be26a-a8de-44b5-9ca6-40a3c86b6e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.615870 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-be2be26a-a8de-44b5-9ca6-40a3c86b6e68 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:21.617353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-be2be26a-a8de-44b5-9ca6-40a3c86b6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:21.643341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 220/439] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:21.644659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e87768-3463-44db-ad20-532f08988ff1 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:21.712301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 220/440] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:21.779894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e87768-3463-44db-ad20-532f08988ff1 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:21.815037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:21.815592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.815866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.816163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] PATH_INFO: `/v3/projects/83c883f6c4b74c0281aa45208ab7de42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.818438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] RBAC: Authorizing `identity:get_project(project_id=83c883f6c4b74c0281aa45208ab7de42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:21.819433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:21.821274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 221/441] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:21 2022] GET /identity/v3/projects/83c883f6c4b74c0281aa45208ab7de42 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:21.826626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be26a-a8de-44b5-9ca6-40a3c86b6e68 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:21.842356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:21.929179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be26a-a8de-44b5-9ca6-40a3c86b6e68 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:21.942350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:21.965875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:21.966514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:21.966790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:21.967062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:21.967509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:21.968235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:21.969693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:21.975995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 221/442] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:21 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:21.981452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.047338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb159ead-2292-4857-a483-7885f3d13990 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.057829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.076523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17631e97-80be-4734-8732-1f88c3caf2c3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.081428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.082048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.082325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.082595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.093114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:22.098064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:22.099410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 222/443] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:22.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.117662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.118274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.118555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.118834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.119589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=83c883f6c4b74c0281aa45208ab7de42) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:22.119901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.121366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.126989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 222/444] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:21 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=83c883f6c4b74c0281aa45208ab7de42&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:22.127772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.197352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.217288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf0361-94e0-4557-9939-a5d07532a365 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.258324 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.258962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.259240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.259511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.263992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa1673-677f-489b-a6a3-6bceb18b91d4 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.270451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:22.275698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:22.276807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:22.277640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 223/445] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:22.283321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.309304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.309946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.310204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.310480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.311148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:22.311451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.312896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.322242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 223/446] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:22.328621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.341458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.409324 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976477-c4c3-4bf9-95ca-7bfad9b7c92b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.450394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.450885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.451164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.451435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.452137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:22.452448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.453831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.457542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e19f-89d6-4161-980a-6003a8960e38 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.463485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 224/447] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:22.468775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.472377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.501258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33947c19-901a-4701-84a3-62016199a69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.501871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33947c19-901a-4701-84a3-62016199a69c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.502148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33947c19-901a-4701-84a3-62016199a69c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.502423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33947c19-901a-4701-84a3-62016199a69c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.587957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33947c19-901a-4701-84a3-62016199a69c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.589747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33947c19-901a-4701-84a3-62016199a69c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.591588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5c0f-2ecf-4b95-90ac-40f400858866 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.603713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.634113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.635095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.636032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.636032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.698837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 224/448] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 04:53:22.704663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33947c19-901a-4701-84a3-62016199a69c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.709430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.710898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.714327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.801668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33947c19-901a-4701-84a3-62016199a69c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.809154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 225/449] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:22.809553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.814831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.838827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.839386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.839667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.840040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] PATH_INFO: `/v3/projects/1aab57a271ef4e04a301d0c13f37422d` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.841476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] RBAC: Authorizing `identity:get_project(project_id=1aab57a271ef4e04a301d0c13f37422d)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.842960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.844705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 225/450] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/projects/1aab57a271ef4e04a301d0c13f37422d => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:22.851046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.912216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886f6e6-a83f-4e3d-aabd-51c7e261411c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.914444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:22.945681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.946307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.946570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.946852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] PATH_INFO: `/v3/projects/7930d95e9a4040bda3c164f09a0f510a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.948006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] RBAC: Authorizing `identity:get_project(project_id=7930d95e9a4040bda3c164f09a0f510a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.949592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.950402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab5bf5-e9eb-4d11-872c-d39f81aa0594 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:22.951621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 226/451] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/projects/7930d95e9a4040bda3c164f09a0f510a => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:22.956894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:22.989817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:22.990994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:22.991282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:22.991725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] PATH_INFO: `/v3/groups/10cb187527714f73adb5ef8227d9101b` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:22.992862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] RBAC: Authorizing `identity:get_group(group_id=10cb187527714f73adb5ef8227d9101b)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:22.994300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:22.995881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 226/452] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/groups/10cb187527714f73adb5ef8227d9101b => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:23.001645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:23.045053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:23.055711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f27fc-76a5-4aaa-9ea1-5eac6e87bb73 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:23.089152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:23.089700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:23.089978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:23.090252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] PATH_INFO: `/v3/groups/509dd68c562a46219d51e25249b0c887` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:23.091365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] RBAC: Authorizing `identity:get_group(group_id=509dd68c562a46219d51e25249b0c887)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:23.092860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:23.094427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 227/453] 10.222.0.45 () {56 vars in 1180 bytes} [Thu Aug 25 04:53:22 2022] GET /identity/v3/groups/509dd68c562a46219d51e25249b0c887 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:23.100484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d17d6-5afd-4f22-bdf7-600d5f1e5454 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:23.100613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:23.134726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83cb8-7594-44bc-b756-3771a5a43273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:23.135326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83cb8-7594-44bc-b756-3771a5a43273 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:23.135607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83cb8-7594-44bc-b756-3771a5a43273 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:23.135880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83cb8-7594-44bc-b756-3771a5a43273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:23.136626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83cb8-7594-44bc-b756-3771a5a43273 None admin] RBAC: Adding query filter params (group.id=10cb187527714f73adb5ef8227d9101b, role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=1aab57a271ef4e04a301d0c13f37422d) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:23.136933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83cb8-7594-44bc-b756-3771a5a43273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:23.138362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83cb8-7594-44bc-b756-3771a5a43273 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:23.141604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:23.143981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 227/454] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:23 2022] GET /identity/v3/role_assignments?group.id=10cb187527714f73adb5ef8227d9101b&scope.project.id=1aab57a271ef4e04a301d0c13f37422d&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:23.204100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07805c0a-bf3c-4f35-964d-b5ee78a0fdda None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:23.239597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080768fb-4f4b-4f25-8f7c-26548a550d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:23.240244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080768fb-4f4b-4f25-8f7c-26548a550d22 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:23.241073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080768fb-4f4b-4f25-8f7c-26548a550d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:23.241524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080768fb-4f4b-4f25-8f7c-26548a550d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:23.242285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080768fb-4f4b-4f25-8f7c-26548a550d22 None admin] RBAC: Adding query filter params (group.id=509dd68c562a46219d51e25249b0c887, role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=7930d95e9a4040bda3c164f09a0f510a) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:23.242591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080768fb-4f4b-4f25-8f7c-26548a550d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:23.244092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080768fb-4f4b-4f25-8f7c-26548a550d22 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:23.250576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 228/455] 10.222.0.45 () {56 vars in 1376 bytes} [Thu Aug 25 04:53:23 2022] GET /identity/v3/role_assignments?group.id=509dd68c562a46219d51e25249b0c887&scope.project.id=7930d95e9a4040bda3c164f09a0f510a&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:25.752506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930b323-0e5b-448d-bae9-396295833284 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:25.753496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930b323-0e5b-448d-bae9-396295833284 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:25.754001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930b323-0e5b-448d-bae9-396295833284 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:25.755950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 228/456] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:25.762398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f824d-fbbf-4569-97e8-2f162fe39f41 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:25.763286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f824d-fbbf-4569-97e8-2f162fe39f41 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:25.763765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f824d-fbbf-4569-97e8-2f162fe39f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:25.793148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-d83f824d-fbbf-4569-97e8-2f162fe39f41 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:25.794669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d83f824d-fbbf-4569-97e8-2f162fe39f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:25.884184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 229/457] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:26.110720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e227a-56ec-4adb-b54c-728a2cb9b8e7 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.111438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e227a-56ec-4adb-b54c-728a2cb9b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.111980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e227a-56ec-4adb-b54c-728a2cb9b8e7 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.113833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 229/458] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:26.119494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfaef1-050e-4cf6-9ef8-34b5b04ffb71 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.120051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfaef1-050e-4cf6-9ef8-34b5b04ffb71 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.120525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfaef1-050e-4cf6-9ef8-34b5b04ffb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.143597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cbdfaef1-050e-4cf6-9ef8-34b5b04ffb71 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:26.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cbdfaef1-050e-4cf6-9ef8-34b5b04ffb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:26.184290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:26.233934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 230/459] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:26.299859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118a23-816e-4746-ad79-5c2e4bc4424a None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.300187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118a23-816e-4746-ad79-5c2e4bc4424a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.300443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118a23-816e-4746-ad79-5c2e4bc4424a None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.301790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 230/460] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:26.307817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0975d-a6a3-47e5-858b-c45e313bcea6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.308140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0975d-a6a3-47e5-858b-c45e313bcea6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.308415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0975d-a6a3-47e5-858b-c45e313bcea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.332879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9ca0975d-a6a3-47e5-858b-c45e313bcea6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:26.334614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9ca0975d-a6a3-47e5-858b-c45e313bcea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:26.422255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 231/461] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:26.436512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118a23-816e-4746-ad79-5c2e4bc4424a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:26.547957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0975d-a6a3-47e5-858b-c45e313bcea6 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:26.597200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118a23-816e-4746-ad79-5c2e4bc4424a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:26.616873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:26.657565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7ce58-ac37-4331-8b33-65077e4e3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:26.658211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7ce58-ac37-4331-8b33-65077e4e3b8a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.658492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7ce58-ac37-4331-8b33-65077e4e3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.658767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7ce58-ac37-4331-8b33-65077e4e3b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.681024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0975d-a6a3-47e5-858b-c45e313bcea6 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:26.682424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7ce58-ac37-4331-8b33-65077e4e3b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:26.683945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7ce58-ac37-4331-8b33-65077e4e3b8a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:26.684247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-3ed7ce58-ac37-4331-8b33-65077e4e3b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:26.706628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:26.707735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:26.708770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:26.708770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:26.708770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:26.711183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 231/462] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:26.712887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73014edd-4b5e-49a0-9820-155aaef11245 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.713369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73014edd-4b5e-49a0-9820-155aaef11245 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.713834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73014edd-4b5e-49a0-9820-155aaef11245 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.719730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 232/463] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:26.721013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73014edd-4b5e-49a0-9820-155aaef11245 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:26.732871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac3300-d2a8-4105-b2d7-0f2c649e5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:26.734036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac3300-d2a8-4105-b2d7-0f2c649e5065 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.734323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac3300-d2a8-4105-b2d7-0f2c649e5065 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.734596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac3300-d2a8-4105-b2d7-0f2c649e5065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.749159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac3300-d2a8-4105-b2d7-0f2c649e5065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:26.750645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac3300-d2a8-4105-b2d7-0f2c649e5065 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-bbac3300-d2a8-4105-b2d7-0f2c649e5065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:26.770843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:26.772886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:26.773756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:26.773756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:26.773756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:26.773756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 232/464] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:26.774189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81047-918b-4f1e-a058-354b122449d4 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.774437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81047-918b-4f1e-a058-354b122449d4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.774715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e81047-918b-4f1e-a058-354b122449d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.798876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f4e81047-918b-4f1e-a058-354b122449d4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:26.800781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f4e81047-918b-4f1e-a058-354b122449d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:26.847760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73014edd-4b5e-49a0-9820-155aaef11245 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:26.877756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 233/465] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:26.878690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81047-918b-4f1e-a058-354b122449d4 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:26.899216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:26.900419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:26.900909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:26.901914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:26.903078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:26.903588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:26.906232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:26.922856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 233/466] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:26.924035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:26.948369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:26.963365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:26.986539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e81047-918b-4f1e-a058-354b122449d4 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.024103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.024714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.024988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.025262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.025895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:27.026207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.027603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.033158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e5e6-9270-4652-8f78-a72d6163184c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.044366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 234/467] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:27.044366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:27.072651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e1a49-aafc-48df-84bd-264e36deb37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.073443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e1a49-aafc-48df-84bd-264e36deb37e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.074032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e1a49-aafc-48df-84bd-264e36deb37e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.074317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e1a49-aafc-48df-84bd-264e36deb37e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.085896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e1a49-aafc-48df-84bd-264e36deb37e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.087350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e1a49-aafc-48df-84bd-264e36deb37e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-242e1a49-aafc-48df-84bd-264e36deb37e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:27.103825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:27.104804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:27.105659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:27.105659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:27.105659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:27.105659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 234/468] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:27.106263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c2d6-f0cf-4146-b948-157169980817 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.106531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c2d6-f0cf-4146-b948-157169980817 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.106786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c2d6-f0cf-4146-b948-157169980817 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.108290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 235/469] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:27.108993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896c2d6-f0cf-4146-b948-157169980817 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:27.155843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa5dfc-1f28-4529-bdcc-28923e5a5f53 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.182917 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:27.190654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.196200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.196200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.196200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.196200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.196200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.202950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:27.214073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896c2d6-f0cf-4146-b948-157169980817 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.247824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba45bc-5d92-467b-ac71-f92a623f8788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.248468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba45bc-5d92-467b-ac71-f92a623f8788 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.248733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba45bc-5d92-467b-ac71-f92a623f8788 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.248996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba45bc-5d92-467b-ac71-f92a623f8788 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.249688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba45bc-5d92-467b-ac71-f92a623f8788 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.251123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba45bc-5d92-467b-ac71-f92a623f8788 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.302168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 235/470] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:53:27 2022] POST /identity/v3/users => generated 246 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:27.303598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:27.333530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 236/471] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:53:27 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:27.342893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641f9f-2362-430d-a485-021727379d18 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.342893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641f9f-2362-430d-a485-021727379d18 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.342893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641f9f-2362-430d-a485-021727379d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.359321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-41641f9f-2362-430d-a485-021727379d18 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:27.360820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-41641f9f-2362-430d-a485-021727379d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:27.450634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 237/472] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:27.451599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641f9f-2362-430d-a485-021727379d18 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:27.468028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e2d6-07a4-4c08-9f89-c91949edcb74 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.507813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.508666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.509004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.509285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.510323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:27.510640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.512349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.526825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:27.528835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 236/473] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:27.534931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:27.586151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641f9f-2362-430d-a485-021727379d18 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.610163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:27.634513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.635525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.635894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.636290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.650996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.652685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:27.671418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:27.672403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:27.673570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:27.673570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:27.673570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:27.673570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 238/474] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:27.675472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8641bc8-c584-4cad-a3aa-f1845b405d2c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.679578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:27.733930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.735291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.735745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.736205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.737666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.739547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.804631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3587e5e-19f1-47c5-af02-5b6bd74f2d5d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:27.814545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:27.824532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 237/475] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:53:27 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:53:27.825373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:27.868233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:27.869930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:27.870498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:27.871937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:27.872821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:27.873335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:27.875180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:27.894082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 239/476] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:27.900277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:28.029946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f2de8-7c6b-40c9-b146-920b2230cc83 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:28.032347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d51a5-2820-4ae6-a534-716d59468f07 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:28.041546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:28.082916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:28.083763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:28.084124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:28.084393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:28.085377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:28.087457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:28.091855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:28.092739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:28.093180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:28.093613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:28.097353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:28.097353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:28.166818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.sql.core [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 04:53:28.166818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 25 04:53:28.166818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [parameters: {'id': '540b65d7b5654166afa02a15cd76e881', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 25 04:53:28.166818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81749) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application conn.query(q) Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application result.read() Aug 25 04:53:28.185501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return ref.to_dict() Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 04:53:28.186433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application next(self.gen) Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application yield resource Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application next(self.gen) Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise self.value Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application session.commit() Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 04:53:28.187765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self.session.flush() Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application compat.raise_( Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 04:53:28.188695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 04:53:28.189580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application conn.query(q) Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application result.read() Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 04:53:28.190389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [parameters: {'id': '540b65d7b5654166afa02a15cd76e881', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:28.191210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 25 04:53:28.193915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:28.196620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 238/477] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 25 04:53:27 2022] POST /identity/v3/roles => generated 144 bytes in 362 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:28.203507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:28.211066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 240/478] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:53:27 2022] POST /identity/v3/users => generated 249 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:28.327417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec9309-2226-4291-a67d-dc40237ae1fc None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:28.364707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930599e-607e-4936-b22b-4f524d34c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:28.366374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930599e-607e-4936-b22b-4f524d34c29c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:28.366910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930599e-607e-4936-b22b-4f524d34c29c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:28.367370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930599e-607e-4936-b22b-4f524d34c29c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:28.378573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930599e-607e-4936-b22b-4f524d34c29c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b930599e-607e-4936-b22b-4f524d34c29c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:28.384409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:28.385372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 04:53:28.386199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:28.393515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 239/479] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:53:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:28.395085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:28.425798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:28.510907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a6598-0cb4-4d85-8d79-bef4253ed1fb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:28.548330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4158a6-3860-4cd0-8910-abd5cd047219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:28.549370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4158a6-3860-4cd0-8910-abd5cd047219 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:28.549841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4158a6-3860-4cd0-8910-abd5cd047219 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:28.550325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4158a6-3860-4cd0-8910-abd5cd047219 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:28.551179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4158a6-3860-4cd0-8910-abd5cd047219 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:28.551725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4158a6-3860-4cd0-8910-abd5cd047219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:28.553499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4158a6-3860-4cd0-8910-abd5cd047219 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:28.568029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 241/480] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:29.634470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538845-5201-4243-b4ab-d2188b14b8e8 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:29.635555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538845-5201-4243-b4ab-d2188b14b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:29.636116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538845-5201-4243-b4ab-d2188b14b8e8 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:29.638036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 240/481] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:29.643066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cce15-692c-4e4d-9e90-ec7789d417f2 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:29.644012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cce15-692c-4e4d-9e90-ec7789d417f2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:29.644486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cce15-692c-4e4d-9e90-ec7789d417f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:29.665865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-9b7cce15-692c-4e4d-9e90-ec7789d417f2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:29.667366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9b7cce15-692c-4e4d-9e90-ec7789d417f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:29.758020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 242/482] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:29.901599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfdf9d-3cb6-4bc8-8aea-63069ea4ad2c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:29.901823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfdf9d-3cb6-4bc8-8aea-63069ea4ad2c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:29.902060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfdf9d-3cb6-4bc8-8aea-63069ea4ad2c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:29.903666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 241/483] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:29.908691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc122-0257-4239-97c0-f2b4b3c65b89 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:29.908972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc122-0257-4239-97c0-f2b4b3c65b89 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:29.909244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc122-0257-4239-97c0-f2b4b3c65b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:29.932286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a04dc122-0257-4239-97c0-f2b4b3c65b89 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:29.933543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a04dc122-0257-4239-97c0-f2b4b3c65b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:29.945656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:30.024771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 243/484] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:30.125258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfdf9d-3cb6-4bc8-8aea-63069ea4ad2c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:30.147801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939f39-5225-4dc9-9019-516b1adba80f None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.148157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939f39-5225-4dc9-9019-516b1adba80f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.148413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939f39-5225-4dc9-9019-516b1adba80f None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.150016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 244/485] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:30.160658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c8e66-168d-4d1b-9bce-ad4403089d31 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.160869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c8e66-168d-4d1b-9bce-ad4403089d31 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.161187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c8e66-168d-4d1b-9bce-ad4403089d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.163214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:30.180649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-fd1c8e66-168d-4d1b-9bce-ad4403089d31 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:30.181685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fd1c8e66-168d-4d1b-9bce-ad4403089d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:30.271977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 245/486] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:30.285455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfdf9d-3cb6-4bc8-8aea-63069ea4ad2c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:30.321808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:30.322488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.322771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.323045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.333802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:30.338795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:30.339716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:30.340579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 242/487] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:30.350147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c8e66-168d-4d1b-9bce-ad4403089d31 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:30.425624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:30.448154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:30.487948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c8e66-168d-4d1b-9bce-ad4403089d31 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:30.544853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:30.545466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.545742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.546011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.546675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:30.546976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:30.548374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:30.557897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 246/488] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:30.564063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:30.618323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:30.630325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe48cf-1cdc-40e3-af77-02d408d191c8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:30.677698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:30.678589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.682627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.682627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.691156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b10a90-5487-47fe-9e56-5b1740b5a349 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:30.696999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:30.703347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:30.704294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:30.705107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 243/489] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:30.705787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:30.734204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:30.734902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.735204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.735549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.744306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:30.748826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:30.750032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:30.765691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:30.766875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:30.767969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:30.767969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:30.767969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:30.772146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 247/490] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:30.773241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:30.822515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e57b87-0d1a-46d7-b4e3-ddabd73d1684 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:30.858993 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:30.859884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.860321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.860727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.872416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:30.879265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:30.880416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:30.881465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:30.883839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 244/491] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:30.884794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:30.890270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d72d0-8e8d-4bb0-a9ff-e5ba85188ac6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:30.901136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:30.938048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:30.938654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:30.938944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:30.939213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:30.939893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:30.940213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:30.941794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:30.952304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 248/492] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:30.952960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.002086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e19914-ed4b-4dc5-a571-e6ff286d45b4 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.031012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.040548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.044267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.044267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.044267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.044267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:31.044267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.044907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.057719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 245/493] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:31.058868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.085071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c293-3a55-45c4-9188-2f649b3fa27e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.118517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb8c3-9108-4725-a0a8-18d22c47c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.119139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb8c3-9108-4725-a0a8-18d22c47c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.119417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb8c3-9108-4725-a0a8-18d22c47c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.119699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb8c3-9108-4725-a0a8-18d22c47c8f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.120387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb8c3-9108-4725-a0a8-18d22c47c8f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:31.120691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb8c3-9108-4725-a0a8-18d22c47c8f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.122089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb8c3-9108-4725-a0a8-18d22c47c8f1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.129973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 249/494] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:31.131711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d605-f6cc-4e7b-8f50-18814a1f4bfc None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.132115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d605-f6cc-4e7b-8f50-18814a1f4bfc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.132301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d605-f6cc-4e7b-8f50-18814a1f4bfc None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.133653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 250/495] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:31.135001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.136690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d605-f6cc-4e7b-8f50-18814a1f4bfc None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.165701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a9d1-4b98-4e3b-b469-0a1d93e6d266 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.199873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017e33b-c2eb-438c-a4a7-49893f4858b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.200451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e33b-c2eb-438c-a4a7-49893f4858b7 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.200728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e33b-c2eb-438c-a4a7-49893f4858b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.201003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e33b-c2eb-438c-a4a7-49893f4858b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.211625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017e33b-c2eb-438c-a4a7-49893f4858b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.213538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017e33b-c2eb-438c-a4a7-49893f4858b7 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-4017e33b-c2eb-438c-a4a7-49893f4858b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:31.228664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:31.229562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:31.230562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:31.230562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:31.230562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:31.230562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 246/496] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:31.231240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7969d-5cf3-45b1-9467-2368a96a2bea None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.231240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7969d-5cf3-45b1-9467-2368a96a2bea None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.231399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7969d-5cf3-45b1-9467-2368a96a2bea None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.232666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 247/497] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:31.233364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7969d-5cf3-45b1-9467-2368a96a2bea None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.244145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d605-f6cc-4e7b-8f50-18814a1f4bfc None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.258630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.290174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75868142-96c6-4443-86ec-5ed9b710eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.290832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75868142-96c6-4443-86ec-5ed9b710eb6f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.291110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75868142-96c6-4443-86ec-5ed9b710eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.291449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75868142-96c6-4443-86ec-5ed9b710eb6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.299858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75868142-96c6-4443-86ec-5ed9b710eb6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.301361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75868142-96c6-4443-86ec-5ed9b710eb6f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-75868142-96c6-4443-86ec-5ed9b710eb6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:31.314236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:31.315219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:31.316678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 251/498] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:31.317412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80246ea-81a3-4f88-b388-df64cfc7baea None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.317412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80246ea-81a3-4f88-b388-df64cfc7baea None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.317562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80246ea-81a3-4f88-b388-df64cfc7baea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.335421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d80246ea-81a3-4f88-b388-df64cfc7baea None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:31.336642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d80246ea-81a3-4f88-b388-df64cfc7baea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:31.344069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7969d-5cf3-45b1-9467-2368a96a2bea None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.367506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.377808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26bf12-82d3-4d46-8617-162ce6dbf7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.381724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26bf12-82d3-4d46-8617-162ce6dbf7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.381724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26bf12-82d3-4d46-8617-162ce6dbf7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.381724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26bf12-82d3-4d46-8617-162ce6dbf7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.389991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26bf12-82d3-4d46-8617-162ce6dbf7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.391459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26bf12-82d3-4d46-8617-162ce6dbf7d4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.402584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 252/499] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:31.403464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80246ea-81a3-4f88-b388-df64cfc7baea None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-1f26bf12-82d3-4d46-8617-162ce6dbf7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:31.405814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:31.406876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:31.407936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:31.407936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:31.407936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:31.407936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 248/500] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:31.408214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0418fb-c6f5-4748-ae52-05e5ac818fa1 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.408328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0418fb-c6f5-4748-ae52-05e5ac818fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.408601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0418fb-c6f5-4748-ae52-05e5ac818fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.430495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3f0418fb-c6f5-4748-ae52-05e5ac818fa1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:31.431783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3f0418fb-c6f5-4748-ae52-05e5ac818fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:31.511931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 249/501] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:31.511931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0418fb-c6f5-4748-ae52-05e5ac818fa1 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.532162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80246ea-81a3-4f88-b388-df64cfc7baea None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.535425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.582160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.583776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.584174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.584667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.585335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:31.585641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.587046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.607734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 253/502] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:31.610181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.641424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0418fb-c6f5-4748-ae52-05e5ac818fa1 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.654703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.688577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.689182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.689454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.689728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.690458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:31.690752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.692243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.734747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 250/503] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:31.734747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.736967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dd79b-d3a5-4dc4-9d30-0788714a78e4 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.772212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.772881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.773163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.773433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.774074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:31.774379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.775752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.788770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 254/504] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:31.789606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.814982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.841954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e875048-1f16-41b6-98d1-423bd9cffaf3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.875259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.875878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.876183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.876451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.884314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.885771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.889528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239363ee-4147-4449-bbf7-1511b8320eab None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:31.898270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:31.899360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 251/505] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:31.900327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:31.926157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:31.927361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:31.928636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:31.929136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:31.929418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:31.943964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:31.945460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:31.967474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:31.968503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:31.969383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:31.969383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:31.969383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:31.969383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 255/506] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:31.970335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.009840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed553-0025-4360-bb80-038ee6ed8bf1 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.043614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.044158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.044435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.044701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.059867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.081828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc315c6-7c92-4ad9-9156-6bff8c05613d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.111960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.113455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.117130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.117755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.118029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.118296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.128439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:32.133994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:32.134932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:32.135729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 256/507] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:32.136954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.137377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.213502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 252/508] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:32.214345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.241539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841747a-1c91-4c80-98bb-2a818018a2a1 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.276958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.277626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.277904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.278179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.280959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.286595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.288116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:32.299139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:32.300209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 257/509] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:32.301107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.319161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a1b38-3e24-4c0d-b440-117dd262acd9 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.341999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.352738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.353355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.357642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.357642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.357642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:32.357642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.357642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.374023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 253/510] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:32.374838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.408529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9faa24-c560-4ad1-a22e-904afbbeb90b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.443717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.444269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.444544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.444806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.445444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:32.445742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.447158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.458827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 258/511] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:32.459645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.474027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781c4ad-723a-41eb-831c-ca0a5427d216 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.508225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.508839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.509120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.509388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.510050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:32.510347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.511728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.515877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.519712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 254/512] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:32.520490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.564512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff5602-5894-4468-bb71-3d44a3872ee3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.565098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.598445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.599893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.600293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.600572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.610487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.611988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.619112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dfa6d-0202-4036-8734-6ca9290aa539 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:32.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:32.627797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:32.633977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:32.633977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:32.633977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:32.633977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 259/513] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:32.633977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.653360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.653968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.654242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.654511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.655227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:32.655526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.657002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.674307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 255/514] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:32.675090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.731190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8899b-6918-40f9-b342-488f21a93381 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.740017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.764605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.765201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.765484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.765803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.778296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0577f6-656b-4610-b310-fe806f36eb37 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:32.779821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:32.812113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:32.812678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:32.812953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:32.813228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:32.813861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.815356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.835198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:32.836689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:32.915887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 256/515] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:53:32 2022] POST /identity/v3/users => generated 247 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:32.916786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.937715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 260/516] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:32.938619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:32.952778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.040844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fea1b-06d7-4f8f-a251-95a66e5ab3de None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.066790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daaa87-1e88-48c7-8ff3-341a0629e068 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.080408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.081721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.082000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.082265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.094733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.096615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.110780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.111396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.111674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.111974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.112628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:33.112932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:33.113568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:33.114415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:33.115762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:33.115762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:33.115762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:33.116770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.116864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 257/517] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:33.116864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.127262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 261/518] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:33.132483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.132619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.198469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.223967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603e25-8ece-4efa-805f-a62fa5de8ead None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.234929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17784a4-8b5f-4f68-b91e-12de4db12cc2 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.260352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.261015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.261288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.261660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.270622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.272038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.272318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.272588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.283351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.284850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:33.300508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:33.301452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:33.302318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:33.302318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:33.302318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:33.306556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 262/519] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:33.307264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.336465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.338693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.352119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.414635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58470f1a-d5be-418b-af1c-296bee59f439 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.439400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.452195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 258/520] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:33.452195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.459486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.460124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.460404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.460673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.461383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:33.461684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.463138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.482093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 263/521] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:33.482093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.560649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01edc3f-9ed5-46cc-ac28-e297c113fe01 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.572717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.585880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd9cb-4d83-428c-bafd-deb9a5c1fa58 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.597758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.598315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.598593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.598861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.606376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.607857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:33.620387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:33.621366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 259/522] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:33.622222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.627655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.628289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.628566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.628887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.629529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:33.629828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.631438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.648175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 264/523] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:33.648175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.691678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.738025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eee444-5966-4c06-b061-f03cea074203 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.758371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4351-b30d-4e1f-9751-a1b5c3159318 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.775323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.775980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.776263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.776535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.786678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.788181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.793239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.793862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.794134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.794402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.802129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.804151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:33.804791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:33.805692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:33.806599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:33.806599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:33.806599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:33.806599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 260/524] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:33.807496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:33.820734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:33.821703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 265/525] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:33.822720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.838841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.921822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc68478-f2d1-458f-aff6-c7b23f9e05f9 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.934774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:33.938869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2bfa0-e884-447c-8dab-a36ccb28f747 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:33.957624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.958328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.958609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.959433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.960193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:33.960500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.961947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:33.976311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:33.977195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:33.977643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:33.978082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:33.982711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 261/526] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:33.983561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:33.986576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:33.988075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:34.000643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:34.001681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:34.002554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 266/527] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:34.003012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.078062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:34.097910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fc826-ff07-4be9-92c8-1f57cf104be0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.117406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fad79d-04f0-4dd3-99f0-66d8d38b625b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.133909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.134514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.134808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.135062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.135700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:34.136039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.137432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.148767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 262/528] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:34.149592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.158288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.159163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.159662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.160067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.160908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:34.161291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.163361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.200686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 267/529] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:34.201606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.222110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:34.265696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5928d-13e1-48cf-955a-809c1e67065a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.307376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.308684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.308684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.308684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.309597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=89cfa7e2f08741d4938a017990b8b031) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:34.310002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.311570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.312842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d273be3-f68e-42ee-af4b-6fb7a0466159 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.328239 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 263/530] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/role_assignments?user.id=89cfa7e2f08741d4938a017990b8b031&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:34.328239 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.336728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:34.364026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.364756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.365634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.365983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.367064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:34.367435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.369898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.395626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 268/531] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:34.397735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.455779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afdc47-7098-4188-a30f-131bec51307b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.494065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.494700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.494978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.495240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.497639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:34.502649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.504156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:34.517506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:34.518582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:34.519547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:34.522248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 264/532] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:34.523222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.537922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4424-8c9e-4c5d-8c9e-3879c9e621df None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.586883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.587766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.588215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.588646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.603711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:34.653697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db419e-eac7-467c-ab49-376ceec49307 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.665300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.666958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.704044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.704905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.708257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.708710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.710110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=1ce4f6719f9b47dda69cc67ed74b45f2) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:34.710566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.713090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.726881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 265/533] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/role_assignments?user.id=1ce4f6719f9b47dda69cc67ed74b45f2&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:34.726881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.773507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:34.828074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 269/534] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:34.832131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:34.914242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccbba7-0bc8-4c63-bef8-66db1326c868 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.946890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:34.953367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca2691-5bf9-44fa-bd02-65e1500937c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:34.954036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca2691-5bf9-44fa-bd02-65e1500937c9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.954315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca2691-5bf9-44fa-bd02-65e1500937c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.954587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca2691-5bf9-44fa-bd02-65e1500937c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.958518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca2691-5bf9-44fa-bd02-65e1500937c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:34.958518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca2691-5bf9-44fa-bd02-65e1500937c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:34.958518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca2691-5bf9-44fa-bd02-65e1500937c9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:34.970323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 266/535] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:34.971653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c672-6414-41b3-9574-fc309c60c363 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:34.972030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c672-6414-41b3-9574-fc309c60c363 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:34.972376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410c672-6414-41b3-9574-fc309c60c363 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:34.974000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 267/536] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:34.976118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb4da1-85e6-487b-9a52-3ca520820543 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:34.979629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410c672-6414-41b3-9574-fc309c60c363 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:35.021492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39459b-cfe2-4802-9980-424d64c23a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:35.022179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39459b-cfe2-4802-9980-424d64c23a72 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:35.022457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39459b-cfe2-4802-9980-424d64c23a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:35.022733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39459b-cfe2-4802-9980-424d64c23a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:35.033570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39459b-cfe2-4802-9980-424d64c23a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:35.035107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39459b-cfe2-4802-9980-424d64c23a72 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-7c39459b-cfe2-4802-9980-424d64c23a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:35.052998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:35.053937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:35.054786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:35.054786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:35.054786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:35.058810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 270/537] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:35.060243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba68b3-3718-42b3-a206-a5fe53137112 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:35.060528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba68b3-3718-42b3-a206-a5fe53137112 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:35.060804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba68b3-3718-42b3-a206-a5fe53137112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:35.079925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-0cba68b3-3718-42b3-a206-a5fe53137112 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:35.081151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0cba68b3-3718-42b3-a206-a5fe53137112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:35.107374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:35.117254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410c672-6414-41b3-9574-fc309c60c363 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:35.152312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 271/538] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:35.153350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba68b3-3718-42b3-a206-a5fe53137112 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:35.160382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:35.160987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:35.161259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:35.161530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:35.162315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=2cc606d7aea34bf09af6ae2dd0f98902) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:35.162619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:35.164071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:35.171438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 268/539] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:34 2022] GET /identity/v3/role_assignments?user.id=2cc606d7aea34bf09af6ae2dd0f98902&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:35.320659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba68b3-3718-42b3-a206-a5fe53137112 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:35.362917 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:35.363533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:35.363810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:35.364089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:35.364733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:35.365689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:35.367184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:35.379514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 272/540] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:35.387459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:35.433895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:35.462481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:35.486188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:35.581652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07b48e-fa09-4bef-8d49-fd68bc7012b5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:35.595770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91cddb-a8f9-46fc-a6b3-81ecad9fa807 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:35.653804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:35.654736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:35.655016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:35.655283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:35.668898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:35.669859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:35.670488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:35.670764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:35.671035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:35.672715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:35.693969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:35.694947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:35.695826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:35.696287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:35.701387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:35.702302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:35.704062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:35.705496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 269/541] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:35.705800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 273/542] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:35.708709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:35.710613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:35.811265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:35.830954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3f40d-a740-4ea4-918d-cf38d53e2a47 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:35.890513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:35.891038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:35.891318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:35.891588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:35.892285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:35.892590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:35.893975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:35.910270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 274/543] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:35.918897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:35.938951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3050a-a1d7-43c9-ab30-8f5e4c46ea38 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:35.961215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:36.005224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:36.005875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.006153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.006520 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.007223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:36.007531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:36.009017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:36.041228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 270/544] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:36.045259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:36.122916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c926a2-5fd6-4d66-bcbb-65735a1027b4 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:36.190163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:36.190716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.190995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.191264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.212789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:36.214303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:36.217362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:36.228102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632a0e-5872-4720-bd95-5fd06124c071 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:36.245862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:36.246794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:36.248183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:36.248183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:36.248183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:36.248183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 275/545] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:36.257586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:36.268275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b64244-e8d0-4174-8e11-8decddcd5456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:36.268893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64244-e8d0-4174-8e11-8decddcd5456 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.269172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64244-e8d0-4174-8e11-8decddcd5456 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.269444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64244-e8d0-4174-8e11-8decddcd5456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.270172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b64244-e8d0-4174-8e11-8decddcd5456 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=3819d2b7da64494f9ed77f670b7c23c8) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:36.270475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b64244-e8d0-4174-8e11-8decddcd5456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:36.272014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b64244-e8d0-4174-8e11-8decddcd5456 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:36.277942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 271/546] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:36 2022] GET /identity/v3/role_assignments?user.id=3819d2b7da64494f9ed77f670b7c23c8&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:36.437493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df4cbe-769d-41b2-b0f4-60326b7ae71d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:36.477801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504135-9dc4-4cf4-bd57-c2687c000aa9 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.477984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504135-9dc4-4cf4-bd57-c2687c000aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.478471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504135-9dc4-4cf4-bd57-c2687c000aa9 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.479661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 272/547] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:53:36.492669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c43c8-6a83-4ff2-a4a0-337a6d5c1675 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.493282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c43c8-6a83-4ff2-a4a0-337a6d5c1675 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.493756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c43c8-6a83-4ff2-a4a0-337a6d5c1675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.505363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:36.506774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.507191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.507472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.508159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:36.508464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:36.509870 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:36.527884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-288c43c8-6a83-4ff2-a4a0-337a6d5c1675 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:36.529495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-288c43c8-6a83-4ff2-a4a0-337a6d5c1675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:36.542160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 276/548] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:36.543460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:36.591083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:36.649438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:36.664839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 273/549] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:36.721920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056965a-2a18-44da-b77a-e3819125a22c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:36.775013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:36.775652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.775947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.776226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.788790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:36.790241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:36.803840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:36.804832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:36.805731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:36.807898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 277/550] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:36.813709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c43c8-6a83-4ff2-a4a0-337a6d5c1675 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:36.941088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c43c8-6a83-4ff2-a4a0-337a6d5c1675 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:36.970952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:36.982652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:36.983272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:36.983550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:36.983965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:36.984706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:36.985007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:36.986515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:37.006706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 274/551] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 25 04:53:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:37.012875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:37.066564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:37.107397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111927e1-9c48-4384-ba2b-3ec7baa3f067 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.140284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:37.169748 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c0fc8-aa53-47d8-b673-a1024cec66fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:37.170383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0fc8-aa53-47d8-b673-a1024cec66fe None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.170668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0fc8-aa53-47d8-b673-a1024cec66fe None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.170943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0fc8-aa53-47d8-b673-a1024cec66fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.204777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ab06f-d755-4c45-ab6f-6bbc55630799 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.204965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c0fc8-aa53-47d8-b673-a1024cec66fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-ef3c0fc8-aa53-47d8-b673-a1024cec66fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:37.210872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:37.211774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:37.212621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 278/552] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:37.213833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4be0-28ac-40b1-b96d-151b4ff45480 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.213833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4be0-28ac-40b1-b96d-151b4ff45480 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.218987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee4be0-28ac-40b1-b96d-151b4ff45480 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.219502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 279/553] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:37.220365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee4be0-28ac-40b1-b96d-151b4ff45480 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:37.247438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:37.248111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.248393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.248669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.322683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:37.324115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:37.335918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee4be0-28ac-40b1-b96d-151b4ff45480 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.353138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:37.373761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94af5b-f837-4a94-aeb4-64c51d5599f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:37.374370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94af5b-f837-4a94-aeb4-64c51d5599f8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.374654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94af5b-f837-4a94-aeb4-64c51d5599f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.374929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94af5b-f837-4a94-aeb4-64c51d5599f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.375595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94af5b-f837-4a94-aeb4-64c51d5599f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:37.375901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94af5b-f837-4a94-aeb4-64c51d5599f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:37.377313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94af5b-f837-4a94-aeb4-64c51d5599f8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:37.386881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 280/554] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:37.388152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a01a-8965-4e7d-b3d8-635f1647c941 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.388441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a01a-8965-4e7d-b3d8-635f1647c941 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.388714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a01a-8965-4e7d-b3d8-635f1647c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.407984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f875a01a-8965-4e7d-b3d8-635f1647c941 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:37.409213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f875a01a-8965-4e7d-b3d8-635f1647c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:37.440369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 275/555] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:37.441334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:37.441604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:37.492102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 281/556] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:37.494120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a01a-8965-4e7d-b3d8-635f1647c941 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:37.554228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d47970-700a-4c52-a1c6-987928f363dd None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.581911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:37.591930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cef12c-4707-40f9-88a9-05d96aad3bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:37.600236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cef12c-4707-40f9-88a9-05d96aad3bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.600236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cef12c-4707-40f9-88a9-05d96aad3bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.600236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cef12c-4707-40f9-88a9-05d96aad3bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.604484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cef12c-4707-40f9-88a9-05d96aad3bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:37.606195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cef12c-4707-40f9-88a9-05d96aad3bd4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-18cef12c-4707-40f9-88a9-05d96aad3bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:37.626853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:37.627783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:37.628703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:37.628703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:37.628703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:37.633230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a01a-8965-4e7d-b3d8-635f1647c941 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.634048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 276/557] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:37.635325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e230d-c950-45a9-8bff-c4d36aebdfa8 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.635667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e230d-c950-45a9-8bff-c4d36aebdfa8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.636079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e230d-c950-45a9-8bff-c4d36aebdfa8 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.641415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 277/558] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:37.641415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e230d-c950-45a9-8bff-c4d36aebdfa8 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:37.677001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339c72e-9355-48c1-9767-65c78901a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:37.677547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c72e-9355-48c1-9767-65c78901a039 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.677829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c72e-9355-48c1-9767-65c78901a039 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.678100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339c72e-9355-48c1-9767-65c78901a039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.694905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339c72e-9355-48c1-9767-65c78901a039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:37.696466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339c72e-9355-48c1-9767-65c78901a039 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-c339c72e-9355-48c1-9767-65c78901a039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:37.715022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:37.716673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:37.717547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:37.717547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:37.717547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:37.720773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 282/559] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:37.722079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed258-9f92-4a24-8f69-a516a08f2535 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.722365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed258-9f92-4a24-8f69-a516a08f2535 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.722694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ed258-9f92-4a24-8f69-a516a08f2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.741670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b91ed258-9f92-4a24-8f69-a516a08f2535 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:37.742881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b91ed258-9f92-4a24-8f69-a516a08f2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:37.757679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:37.778933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e230d-c950-45a9-8bff-c4d36aebdfa8 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.820938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 283/560] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:37.821128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:37.821128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.821318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed258-9f92-4a24-8f69-a516a08f2535 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:37.821390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.821390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:37.821390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:37.821390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:37.821390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:37.840844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 278/561] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:37.841715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:37.889107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:37.958292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69be858-890c-43b2-b691-27f77232bee8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.969176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ed258-9f92-4a24-8f69-a516a08f2535 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:37.996343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:37.997447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:37.997827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:37.998445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.006153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.007399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.007858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.008401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.009366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:38.009871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.010938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:38.011771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:38.016379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:38.017315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:38.018158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 279/562] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:38.018882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.032610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 284/563] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:38.033826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.052791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.135763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.139248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19d9c8-39a7-4f90-a421-8cbfb947943d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.142965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca757ce3-3fa1-4b33-a28c-8d7dfd7192e1 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.174433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.175197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.175559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.175899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.180299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.180906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.181194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.181463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.182127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:38.182427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.183606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.183801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.185221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.192363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 285/564] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:38.193412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:38.196504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:38.197439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 280/565] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:38.198362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.273043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.310356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9583e-2843-44fa-8b32-b3807c354ee4 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.313679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d438-79e3-4b98-b4d6-4f62e9f0d0c3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.351082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.351659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.351823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.352011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.352310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.352542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.352640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.352849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.359855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.361264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.364258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:38.370074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:38.371505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:38.372891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 281/566] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:38.373994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:38.383776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 286/567] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:38.387796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.390224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.402533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.484712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9252e-bc56-42bb-8aab-0274afd52469 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.549686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48584e1-4625-4215-ab41-fbbb560635ea None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.550511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.551140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.551420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.551714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.562043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.563503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:38.578076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:38.579144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:38.585045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:38.585045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:38.585045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:38.585261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.585338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 282/568] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:38.585338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.587061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.587673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.587973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.593983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.593983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:38.593983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.593983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.608482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 287/569] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:38.609408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.658065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.689571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301964ee-77ed-442e-9a40-c85f70235706 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.717997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22538d31-8fe7-4cd5-b00e-08aa26b9fa38 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.730311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65f817-84f5-40fc-b8e2-9983233af276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.730924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f817-84f5-40fc-b8e2-9983233af276 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.731207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f817-84f5-40fc-b8e2-9983233af276 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.731488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f817-84f5-40fc-b8e2-9983233af276 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.732187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65f817-84f5-40fc-b8e2-9983233af276 None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:38.732549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65f817-84f5-40fc-b8e2-9983233af276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.733977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65f817-84f5-40fc-b8e2-9983233af276 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.743114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 283/570] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:38.744314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c717-d046-4f32-8553-9f1b35769e62 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.744636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c717-d046-4f32-8553-9f1b35769e62 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.744937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c717-d046-4f32-8553-9f1b35769e62 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.746295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 284/571] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:38.747119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00c717-d046-4f32-8553-9f1b35769e62 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.754994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.755615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.755885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.756269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.756970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:38.757275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.758708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.770336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 288/572] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:38.771701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.821065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.852322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00c717-d046-4f32-8553-9f1b35769e62 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.872877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c4349-679d-4b43-8658-055a9757d10f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:38.880942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:38.886140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.886755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.887035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.887366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.888090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:38.894262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.894262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.906172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 285/573] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:38.906172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:38.911228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56f0e3-0069-4566-93cb-d969407d41cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:38.911859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56f0e3-0069-4566-93cb-d969407d41cf None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.912177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56f0e3-0069-4566-93cb-d969407d41cf None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.912452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56f0e3-0069-4566-93cb-d969407d41cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.923005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56f0e3-0069-4566-93cb-d969407d41cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:38.924555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56f0e3-0069-4566-93cb-d969407d41cf None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-bc56f0e3-0069-4566-93cb-d969407d41cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:38.938926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:38.940070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:38.941606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:38.941606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:38.941606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:38.941606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 289/574] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:38.945292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf642e-686d-4ff0-a31f-fa18f579bc2e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:38.945696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf642e-686d-4ff0-a31f-fa18f579bc2e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:38.945977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf642e-686d-4ff0-a31f-fa18f579bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:38.964558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-adbf642e-686d-4ff0-a31f-fa18f579bc2e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:38.965765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-adbf642e-686d-4ff0-a31f-fa18f579bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:39.002490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4365a4-37c7-47a8-84e1-d92c803b2358 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.031007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 290/575] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:39.032011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf642e-686d-4ff0-a31f-fa18f579bc2e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.037364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.037985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.038282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.038535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.049035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.050503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:39.069187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:39.070195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:39.071079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:39.071079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:39.071079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:39.071286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 286/576] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:39.072012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.078043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.121712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.157190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf642e-686d-4ff0-a31f-fa18f579bc2e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.179463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3579832-0f6c-4e55-9b9e-38ef7ff5d295 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.192903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.193856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.193856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.194114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.194879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=3101f5b8db404c0893687ad8cc51bb4b) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:39.195111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.196584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.210782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 291/577] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/role_assignments?user.id=3101f5b8db404c0893687ad8cc51bb4b&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:39.210782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.228612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.229269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.229732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.230006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.242179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.244414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:39.260301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:39.261321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 04:53:39.262280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:39.267433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 287/578] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:39.268760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.320262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.327747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b045a7e-3242-4c4d-8608-a2b4d9a4fa34 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.374862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.375474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.375752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.376057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.376700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:39.377004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.378382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.388432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee1df9-7edc-46bd-8e11-944bf813c41e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.391246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 292/579] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:39.391818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.396429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.426225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.426837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.427121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.427615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.428377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:39.428719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.430146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.442219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 288/580] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:39.443617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.508369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5c8fe-c7ed-4c13-812f-574969e84899 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.545671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.546364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.546555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.546807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.547682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:39.547858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.549266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.550703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593c7d0-4139-46f8-9335-86bfcc0b4a9e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.569748 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 293/581] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:39.570411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.585203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.593196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.594069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.598293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.598293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.607551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:39.612886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:39.613900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:39.615281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 289/582] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:39.616725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.648006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.689777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabddd21-ca32-4af6-ac9d-7c94c80328c4 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.731106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.731783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.732259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.732681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.734909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929233a1-08f3-4054-aa9d-1ad2584e2f99 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.741084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.742546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:39.754690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:39.756609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:39.757683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 294/583] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:39.761749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.777297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.777964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.778299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.778563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.785898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.787533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:39.799532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:39.800694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:53:39.802074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:39.806178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 290/584] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:39.807541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.836435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.868743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d77bd-94d8-4f55-8d8f-f325aef57cf3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.903518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:39.905315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.905939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.906218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.906489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.917702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.919150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.922126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f409c2-8b56-4282-8f32-27d71285bead None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:39.934084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:39.935061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:39.936037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:39.936037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:39.936037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:39.936037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 295/585] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:39.936037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:39.968005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:39.968565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:39.968844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:39.969116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:39.969776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:39.970079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:39.971457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:39.979892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 291/586] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:39.980713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.057426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c5caf-104e-4be6-bfc9-bbd0ce967404 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.082818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:40.094606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc95fa-ced4-4950-8cab-837d6ad09dd3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.102530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6409c-5458-454f-a854-112476723af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.102530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6409c-5458-454f-a854-112476723af5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.102530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6409c-5458-454f-a854-112476723af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.102530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6409c-5458-454f-a854-112476723af5 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.102895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6409c-5458-454f-a854-112476723af5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:40.102895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6409c-5458-454f-a854-112476723af5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.102895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6409c-5458-454f-a854-112476723af5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.111213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 296/587] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:40.112063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6409c-5458-454f-a854-112476723af5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.138234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.138992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.139369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.139707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.140631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:40.140998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.142497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.161930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 292/588] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 25 04:53:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:40.162934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.171124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:40.220041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6409c-5458-454f-a854-112476723af5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.256554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.257242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.257592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.257930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.258634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:40.259011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.260418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.268719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c0bc-9fc9-4a14-b253-8bb19fc77f61 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.276722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 297/589] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:40.276722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.307172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.308108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.308523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.308925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.321807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.323591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.331068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:40.339742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:40.341026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:40.342120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:40.342120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:40.342120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:40.345687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 293/590] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:40.348193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.393227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050f2dc-735e-4afa-943e-f85ecf549161 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.409441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:40.429740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.430403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.430679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.430955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/89cfa7e2f08741d4938a017990b8b031/roles/0906f5915c62440697970a4f9c746228` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.445302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=89cfa7e2f08741d4938a017990b8b031, role_id=0906f5915c62440697970a4f9c746228)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.446774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.457705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980381a-8867-4fba-a714-6bbe1a65e0a8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.492281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.492905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.493188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.493461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.503933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.505429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:40.519543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:40.520685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:40.522234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:40.522234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:40.522234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:40.524044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 294/591] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:40.525017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.571934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 298/592] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:53:40 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/89cfa7e2f08741d4938a017990b8b031/roles/0906f5915c62440697970a4f9c746228 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:40.571934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.635111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8ef04-0a15-4474-ad3e-aa2cb93c407b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.648582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:40.676249 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.676798 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.677085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.677598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.686587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.688217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:40.702279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:40.703241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:40.704174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:40.711422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 295/593] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:40.711635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:40.711732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.718581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544a0bd-bc15-4fb3-ba35-89b6256c7b94 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.766559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.767195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.767550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.767894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.769044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:40.769567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.771802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.790024 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 299/594] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:40.791330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.837611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fc390-a9f9-48a6-af20-8f43cc445325 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.883041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.883959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.884251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.884524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.885181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:40.885487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.887683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.903485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 296/595] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:40.903845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffead0-a770-44b4-a213-3d6a79ff245e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:40.904166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.946135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:40.946986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:40.947407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:40.947853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:40.948730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:40.949013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:40.949719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:40.951604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:40.973389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 300/596] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:40.973389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:40.991611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:41.054287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6bd2-02a0-4a6b-aa0b-f618d6bcd68a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.088412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4913a-db21-40ba-96d0-d085e5393b67 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.102880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.103522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.103804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.104120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.112469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.114042 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:41.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:41.128028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:41.128977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 297/597] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:41.129569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:41.139306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3e9e8-3aad-47af-976a-dff066e69733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.139965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3e9e8-3aad-47af-976a-dff066e69733 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.140575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3e9e8-3aad-47af-976a-dff066e69733 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.140853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3e9e8-3aad-47af-976a-dff066e69733 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.148561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3e9e8-3aad-47af-976a-dff066e69733 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.150012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3e9e8-3aad-47af-976a-dff066e69733 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-18e3e9e8-3aad-47af-976a-dff066e69733 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:41.160954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:41.162550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:41.163487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 301/598] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:41.164013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0a5b-cda5-4718-85b5-1dd8cfd09b3b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.164086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0a5b-cda5-4718-85b5-1dd8cfd09b3b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.164948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0a5b-cda5-4718-85b5-1dd8cfd09b3b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.168047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 302/599] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:41.168823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb0a5b-cda5-4718-85b5-1dd8cfd09b3b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:41.230317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:41.243412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01ec18-54fd-4135-832e-dd2e658e76ed None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.250037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:41.276219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb0a5b-cda5-4718-85b5-1dd8cfd09b3b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.278052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e52479-c942-4fd4-b2f3-9f8b617ab8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.278789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e52479-c942-4fd4-b2f3-9f8b617ab8a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.279143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e52479-c942-4fd4-b2f3-9f8b617ab8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.279478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e52479-c942-4fd4-b2f3-9f8b617ab8a1 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/1ce4f6719f9b47dda69cc67ed74b45f2/roles/0906f5915c62440697970a4f9c746228` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.295267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e52479-c942-4fd4-b2f3-9f8b617ab8a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=1ce4f6719f9b47dda69cc67ed74b45f2, role_id=0906f5915c62440697970a4f9c746228)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.296898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e52479-c942-4fd4-b2f3-9f8b617ab8a1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.311571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.312150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.312430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.312698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.313422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:41.313730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.315150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.332230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 303/600] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Aug 25 04:53:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:41.333027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:41.415938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 298/601] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:53:41 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/1ce4f6719f9b47dda69cc67ed74b45f2/roles/0906f5915c62440697970a4f9c746228 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:41.415938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2876-92ae-4d1e-acf0-857c6b8ed8de None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.415938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2876-92ae-4d1e-acf0-857c6b8ed8de None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.415938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2876-92ae-4d1e-acf0-857c6b8ed8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.433370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3e8a2876-92ae-4d1e-acf0-857c6b8ed8de None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:41.434855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3e8a2876-92ae-4d1e-acf0-857c6b8ed8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:41.457705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef99509-efce-45b3-9b13-e5192d43e4f2 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.501321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:41.507334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.508592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.509002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.509375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.510263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:41.510669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.512246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.531837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 304/602] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:41.531837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:41.538545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 299/603] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:41.539744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2876-92ae-4d1e-acf0-857c6b8ed8de None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:41.626132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:41.658033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa881b84-d16b-44af-9382-d8a045474fbd None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.662695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2876-92ae-4d1e-acf0-857c6b8ed8de None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.694558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.695193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.695527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.695733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.702075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.703024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.703454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.703876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/2cc606d7aea34bf09af6ae2dd0f98902/roles/0906f5915c62440697970a4f9c746228` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.709666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.711371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.723399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=2cc606d7aea34bf09af6ae2dd0f98902, role_id=0906f5915c62440697970a4f9c746228)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.725603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:41.727034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:41.728200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:41.729240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:41.729240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:41.729240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:41.729240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 305/604] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:41.734506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:41.786784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:41.841900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6f00e-ed69-4a1f-a1ea-a65c1a585013 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:41.861447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 300/605] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:53:41 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/2cc606d7aea34bf09af6ae2dd0f98902/roles/0906f5915c62440697970a4f9c746228 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:41.877510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:41.878040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:41.878316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:41.878583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:41.879232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:41.879530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:41.881354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:41.894904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 306/606] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:41.900990 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:41.911724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:42.026786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf50804-d037-435a-bd0d-46c92280a4b9 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:42.035227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:42.064512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:42.065159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.065438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.065713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.079949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:42.084741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:42.086382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:42.087629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 307/607] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:42.098999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:42.124487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254c17-6fd4-46ae-8550-deadc38a7d91 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:42.172393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:42.180130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:42.180863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.181221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.181691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.190745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:42.193368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:42.210445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:42.211573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:42.212769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:42.213908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 301/608] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:42.220870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:42.234574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df015242-8b76-4b9c-8a7c-e7dc5567816f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:42.273296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:42.274174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.274602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.275016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.275842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:42.276311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:42.277942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:42.288064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 308/609] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:42.293110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:42.323989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:42.353765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4985d-b9c1-4486-8c36-867f22517c17 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:42.404137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:42.405048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.405329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.405596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.406297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:42.406599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:42.411220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:42.423111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3088252-d644-4d2e-a62a-efc8ae65ab5c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:42.440856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 302/610] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:42.447084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:42.491536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:42.495070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.495368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.495647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.510275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:42.511741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:42.527451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:42.528466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:42.529354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:42.529354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:42.529354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:42.529354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 309/611] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:42.535096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:42.552687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:42.628758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f5e15-fbf2-4d7c-b69b-3702c8bbc7a1 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:42.695643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:42.703928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51402a-a0c8-49eb-9061-0e8967c9fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:42.705060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51402a-a0c8-49eb-9061-0e8967c9fb0f None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.705419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51402a-a0c8-49eb-9061-0e8967c9fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.705700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51402a-a0c8-49eb-9061-0e8967c9fb0f None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/3819d2b7da64494f9ed77f670b7c23c8/roles/0906f5915c62440697970a4f9c746228` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.738677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789be84-5333-4f1c-963f-f8bbf5258e62 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:42.740926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51402a-a0c8-49eb-9061-0e8967c9fb0f None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=3819d2b7da64494f9ed77f670b7c23c8, role_id=0906f5915c62440697970a4f9c746228)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:42.742415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51402a-a0c8-49eb-9061-0e8967c9fb0f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:42.781883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eca1b-649d-4c43-bb5a-3d7512b110e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:42.782492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eca1b-649d-4c43-bb5a-3d7512b110e1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.782771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eca1b-649d-4c43-bb5a-3d7512b110e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.783116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eca1b-649d-4c43-bb5a-3d7512b110e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.783766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eca1b-649d-4c43-bb5a-3d7512b110e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:42.784108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eca1b-649d-4c43-bb5a-3d7512b110e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:42.785490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eca1b-649d-4c43-bb5a-3d7512b110e1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:42.798104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 310/612] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:42.799151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c3bcb-79db-4e87-862e-1dd3cb2eee0b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.799434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c3bcb-79db-4e87-862e-1dd3cb2eee0b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.799817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c3bcb-79db-4e87-862e-1dd3cb2eee0b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.801328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 311/613] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:42.804065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c3bcb-79db-4e87-862e-1dd3cb2eee0b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:42.825948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 303/614] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:53:42 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/3819d2b7da64494f9ed77f670b7c23c8/roles/0906f5915c62440697970a4f9c746228 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:42.827958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e973af-8021-4b38-9a40-1f2081515262 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:42.828662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e973af-8021-4b38-9a40-1f2081515262 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:42.828952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e973af-8021-4b38-9a40-1f2081515262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:42.854060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b9e973af-8021-4b38-9a40-1f2081515262 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:42.856333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b9e973af-8021-4b38-9a40-1f2081515262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:42.947216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 304/615] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:42.999239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c3bcb-79db-4e87-862e-1dd3cb2eee0b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:43.038064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:43.039050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.039525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.040022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.047672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:43.049374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:43.051482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:43.062647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:43.075060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:43.076055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 312/616] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:43.076668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e973af-8021-4b38-9a40-1f2081515262 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:43.096402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:43.216576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e973af-8021-4b38-9a40-1f2081515262 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:43.254170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:43.255138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.256401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.256979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.257945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:43.258460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:43.260161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:43.279349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 305/617] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 25 04:53:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:43.285121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:43.299105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:43.443890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:43.474029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae067a-1d6c-4876-8ad6-b73536ddbe16 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:43.498260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a8647-3dc7-442c-b15e-d5d194f43b66 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:43.525549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:43.526188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.526459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.526725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.546827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:43.551541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:43.553059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:43.554147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 306/618] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:43.560436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:43.585214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:43.585857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.586140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.586413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.617850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:43.619342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:43.653557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:43.654598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:43.655517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:43.655517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:43.655517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:43.660426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 313/619] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:43.668916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:43.673482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2be4d-1b0e-4e47-950e-df8463217b7e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:43.709178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:43.709966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.710244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.710512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.711184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:43.711482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:43.712911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:43.718745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:43.722256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 307/620] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:43.729571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:43.787474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:43.853802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5cfd0-c713-4c94-a702-6ee90641d534 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:43.869789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e243-513c-4fda-a99a-af2d15b07a19 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:43.893729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d82a-219a-4326-8e9c-d23c8f91da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:43.894814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d82a-219a-4326-8e9c-d23c8f91da06 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.895318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d82a-219a-4326-8e9c-d23c8f91da06 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.895852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d82a-219a-4326-8e9c-d23c8f91da06 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.896865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d82a-219a-4326-8e9c-d23c8f91da06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:43.897488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d82a-219a-4326-8e9c-d23c8f91da06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:43.899092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d82a-219a-4326-8e9c-d23c8f91da06 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:43.905131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268d707-6527-45ad-8dcf-58ad2387f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:43.905764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268d707-6527-45ad-8dcf-58ad2387f280 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.906036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268d707-6527-45ad-8dcf-58ad2387f280 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.906302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268d707-6527-45ad-8dcf-58ad2387f280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.918322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268d707-6527-45ad-8dcf-58ad2387f280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:43.918930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 314/621] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:43.919333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268d707-6527-45ad-8dcf-58ad2387f280 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:43.920897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea57b07-4bf6-4b1b-b199-5a95318f419c None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.921348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea57b07-4bf6-4b1b-b199-5a95318f419c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.921874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea57b07-4bf6-4b1b-b199-5a95318f419c None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.923698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 315/622] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:43.928104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea57b07-4bf6-4b1b-b199-5a95318f419c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-2268d707-6527-45ad-8dcf-58ad2387f280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:43.935699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:43.936738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:43.937711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:43.937711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:43.937711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:43.939754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 308/623] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:43.941162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27e52-3c04-4088-85bf-428528dc23ff None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:43.941652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27e52-3c04-4088-85bf-428528dc23ff None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:43.942144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27e52-3c04-4088-85bf-428528dc23ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:43.961607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-11f27e52-3c04-4088-85bf-428528dc23ff None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:43.963126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-11f27e52-3c04-4088-85bf-428528dc23ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:44.014107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:44.038533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 309/624] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:44.039855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f27e52-3c04-4088-85bf-428528dc23ff None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.057192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea57b07-4bf6-4b1b-b199-5a95318f419c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.076207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:44.130042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:44.131390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.131756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.132059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.152984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:44.154457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:44.172778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f27e52-3c04-4088-85bf-428528dc23ff None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:44.183930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:44.184883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 316/625] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:44.185802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.231147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:44.231871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.232077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.232336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.233163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:44.233471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:44.234867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:44.255220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 310/626] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:44.261098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.339107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:44.358720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53951eb1-468a-43a4-abdf-179dfe8b143b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.399494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b4c8f-7c7e-487e-a5b5-041e2087ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:44.400155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4c8f-7c7e-487e-a5b5-041e2087ee23 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.400432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4c8f-7c7e-487e-a5b5-041e2087ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.400705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4c8f-7c7e-487e-a5b5-041e2087ee23 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.401417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b4c8f-7c7e-487e-a5b5-041e2087ee23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:44.401720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b4c8f-7c7e-487e-a5b5-041e2087ee23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:44.402182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4488e-42b2-4a24-bfe4-916e81129d64 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.403175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b4c8f-7c7e-487e-a5b5-041e2087ee23 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:44.421939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 317/627] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:44.421939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf65ac-0f5b-4011-9558-ca61ad95ff88 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.421939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf65ac-0f5b-4011-9558-ca61ad95ff88 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.421939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf65ac-0f5b-4011-9558-ca61ad95ff88 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.421939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 318/628] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:44.421939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf65ac-0f5b-4011-9558-ca61ad95ff88 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.449280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:44.457850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.457850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.457850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.458138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:44.458219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:44.460360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:44.471595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:44.472666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:44.473734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 311/629] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:53:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:44.474618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.534541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf65ac-0f5b-4011-9558-ca61ad95ff88 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.572289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f070a8-9309-4656-85ce-36a23cef28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:44.572972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f070a8-9309-4656-85ce-36a23cef28a1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.573265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f070a8-9309-4656-85ce-36a23cef28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.573534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f070a8-9309-4656-85ce-36a23cef28a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.585715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f070a8-9309-4656-85ce-36a23cef28a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:44.587262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:44.590430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384873-b6f3-45d0-96bf-229bbf9ab49e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-93f070a8-9309-4656-85ce-36a23cef28a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:44.590610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:44.591559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:44.592462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 319/630] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:44.593488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313f27-d3f6-4fa5-af1e-61c0346c7982 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.593752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313f27-d3f6-4fa5-af1e-61c0346c7982 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.594027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313f27-d3f6-4fa5-af1e-61c0346c7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.613808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-52313f27-d3f6-4fa5-af1e-61c0346c7982 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:44.615745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-52313f27-d3f6-4fa5-af1e-61c0346c7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:44.631019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:44.631975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.632516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.632792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/3101f5b8db404c0893687ad8cc51bb4b/roles/0906f5915c62440697970a4f9c746228` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.649167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=3101f5b8db404c0893687ad8cc51bb4b, role_id=0906f5915c62440697970a4f9c746228)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:44.650659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:44.689560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 320/631] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:44.690470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313f27-d3f6-4fa5-af1e-61c0346c7982 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.717318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:44.738714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 312/632] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:53:44 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/3101f5b8db404c0893687ad8cc51bb4b/roles/0906f5915c62440697970a4f9c746228 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:44.741544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.876211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d321904-2e0a-44c0-bfc5-9d494e367173 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.924919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:44.926224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:44.926753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:44.927823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:44.930128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:44.930681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:44.932334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:44.946147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 313/633] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:44.947424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313f27-d3f6-4fa5-af1e-61c0346c7982 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:44.952127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:44.975215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.000993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.001969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.002453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.002927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.003855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:45.004490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.006577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.026300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 321/634] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:53:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:45.027456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.076736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628981-1b59-4fa8-ba01-8aebb8aeb0e1 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.115190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.115812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.116117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.116388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.121892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.127256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.128677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:45.144151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:45.145134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:45.146778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:45.146778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:45.146778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:45.146953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700ce1-d176-4e75-86fd-6fc99d994e47 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.147028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 314/635] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:45.147539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.188145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14604655-7a41-4eb2-8f0c-f330f37155df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.188770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604655-7a41-4eb2-8f0c-f330f37155df None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.189044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604655-7a41-4eb2-8f0c-f330f37155df None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.189313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14604655-7a41-4eb2-8f0c-f330f37155df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.200642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14604655-7a41-4eb2-8f0c-f330f37155df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-14604655-7a41-4eb2-8f0c-f330f37155df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:45.205314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:45.206269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:45.207107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 322/636] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:45.207811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f106-2f2e-4144-ab5b-f87c6655797c None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.207881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f106-2f2e-4144-ab5b-f87c6655797c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.209087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f106-2f2e-4144-ab5b-f87c6655797c None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.210341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 323/637] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:45.211050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32f106-2f2e-4144-ab5b-f87c6655797c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.226474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.269469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c018ca-02e1-46f0-959f-b5bcbade7c5f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.309881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c2fd0-118b-4620-8bfe-c1ca22f2df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.310919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2fd0-118b-4620-8bfe-c1ca22f2df24 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.311479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2fd0-118b-4620-8bfe-c1ca22f2df24 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.311764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c2fd0-118b-4620-8bfe-c1ca22f2df24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.316900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32f106-2f2e-4144-ab5b-f87c6655797c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.354378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.354979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.355256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.355527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.356197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:45.356498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.357867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.365695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.371024 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 324/638] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:45.371668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.398592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2fd0-118b-4620-8bfe-c1ca22f2df24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.400063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c2fd0-118b-4620-8bfe-c1ca22f2df24 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.482564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.484978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b9942-988c-4b8a-9d04-bfc297198302 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.522062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.522936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.523218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.523495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.524192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:45.524504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.530062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 315/639] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:45.530226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.530308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7bd0-cdcb-4955-b5e7-3cb38d2963ae None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.530308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7bd0-cdcb-4955-b5e7-3cb38d2963ae None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.530308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb7bd0-cdcb-4955-b5e7-3cb38d2963ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.535132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 325/640] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:45.535341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.549743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c8bb7bd0-cdcb-4955-b5e7-3cb38d2963ae None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:45.550951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c8bb7bd0-cdcb-4955-b5e7-3cb38d2963ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:45.601031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.628301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 316/641] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:45.628301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb7bd0-cdcb-4955-b5e7-3cb38d2963ae None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.647868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fabc-ee8d-4d76-a5a6-66cc12c398c8 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.683793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.684379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.684662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.684936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.693162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.694859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:45.706576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:45.707712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 326/642] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:45.709347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.759286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.769288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb7bd0-cdcb-4955-b5e7-3cb38d2963ae None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.819563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046f94-f5ab-4d08-99d9-16baa81ac395 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:45.820019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.820881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.821617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.823037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.839569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.841489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.842818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:45.857263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:45.857978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:45.858320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:45.858662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:45.864133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:45.865745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:45.866676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:45.866676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:45.866676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:45.869868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 317/643] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:45.871709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:45.871843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:45.873425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:45.889402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:45.890617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:45.891897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:45.891897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:45.891897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:45.892940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 327/644] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:45.898333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.000802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8e081-8c88-4a23-baf5-84dfc6c90d0d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.007075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4b34-1d10-444d-9e1c-90cfec3b1a4e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.037607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.038213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.038491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.038800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.039478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:46.039783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.041325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.043979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.044592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.044875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.045145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.045790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:46.046094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.047450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.063115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 318/645] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:46.063310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 328/646] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:46.063423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.063511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.070031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.098501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.175065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227188d-3ef6-4f9e-ad9f-8f9c5d638be7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.176622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4394-4899-4442-a4a6-addf280b79eb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.210880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.211509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.211784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.212072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.212710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:46.213012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.214377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.214636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.215463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.215992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.216581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.226692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 319/647] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:46.227748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.228634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:46.233858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:46.234808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:46.235648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 329/648] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:46.236394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.298098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.338791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51df60-522b-43fe-b151-ad7c8ec445b1 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.339967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.348717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3235f6-2fdd-4295-a75b-7ea0a888e45b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.377725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.378864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.379357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.379845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.385103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432cea2-c119-468d-a839-0365a540600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.386315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432cea2-c119-468d-a839-0365a540600d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.386770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432cea2-c119-468d-a839-0365a540600d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.387229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432cea2-c119-468d-a839-0365a540600d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.394787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432cea2-c119-468d-a839-0365a540600d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.397476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432cea2-c119-468d-a839-0365a540600d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-4432cea2-c119-468d-a839-0365a540600d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:46.410659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:46.413074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:46.414222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:46.415450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 330/649] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:46.416294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432cea2-c119-468d-a839-0365a540600d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.461480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.475401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.526900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432cea2-c119-468d-a839-0365a540600d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.528035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.565731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.566281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.566557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.566822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.567643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 320/650] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:46.568657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.575730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.577291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:46.589873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:46.590844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:46.592824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 331/651] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:46.596163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.611490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.683518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb10181-8ae2-4511-a06b-b547cd6a7fb8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.697451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1bf10-dc63-44d7-a863-23f06c8240ee None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.727285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.727893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.728218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.728491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.729153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:46.729460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.730840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.734511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.735170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.735450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.735713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.736424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:46.736731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.738136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.743745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 321/652] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:46.743745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.756877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 332/653] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:46.762205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.771467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.835941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:46.848453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946d3a4-cf1e-45ca-85e9-d404947537ca None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.871496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86a8aa-51eb-499d-a6ec-878a8c68c5f4 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:46.885473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.886105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.886379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.886655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.896719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.898171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.906395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:46.906985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:46.907258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:46.907524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:46.908267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:46.908567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:46.910090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:46.913001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:46.913930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:46.914860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:46.914860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:46.914860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:46.914860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 322/654] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:46.914860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.929158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 333/655] 10.222.0.45 () {56 vars in 1137 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:46.929986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:46.995792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.016863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c71f73-5a88-4990-bb62-33edeebb2e76 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.030561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8f97e-9d67-4e16-b2e2-7ba51767686c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.050497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.051120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.051393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.051659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.058403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.063292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.063663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa70bb-b0d4-41d2-ae4d-9a91747501e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.064277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa70bb-b0d4-41d2-ae4d-9a91747501e5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.064551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa70bb-b0d4-41d2-ae4d-9a91747501e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.064788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.064916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa70bb-b0d4-41d2-ae4d-9a91747501e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.065514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa70bb-b0d4-41d2-ae4d-9a91747501e5 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=89cfa7e2f08741d4938a017990b8b031) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:47.065814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa70bb-b0d4-41d2-ae4d-9a91747501e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.067262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa70bb-b0d4-41d2-ae4d-9a91747501e5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.074094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 334/656] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/role_assignments?user.id=89cfa7e2f08741d4938a017990b8b031&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:47.075084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924526c-9a99-4118-9137-1b216895c519 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.075364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924526c-9a99-4118-9137-1b216895c519 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.075634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924526c-9a99-4118-9137-1b216895c519 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.076961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 335/657] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:47.079999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:47.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:47.087502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:47.087502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:47.087502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:47.087502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 323/658] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:47.087805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924526c-9a99-4118-9137-1b216895c519 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.087895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.204376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2b421-2010-4fee-83d7-e4107105103f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.208914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924526c-9a99-4118-9137-1b216895c519 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.239142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.247588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.248396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.251455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.251455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.251607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de2a41-b5e1-4084-97e2-fa5fd0e60bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.251607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2a41-b5e1-4084-97e2-fa5fd0e60bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.251607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2a41-b5e1-4084-97e2-fa5fd0e60bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.251815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2a41-b5e1-4084-97e2-fa5fd0e60bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.252459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2a41-b5e1-4084-97e2-fa5fd0e60bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:47.253270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2a41-b5e1-4084-97e2-fa5fd0e60bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.254110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2a41-b5e1-4084-97e2-fa5fd0e60bf7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.267432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 336/659] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:47.269047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851128-fc85-45ce-898b-99ba06c59cbb None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.269484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851128-fc85-45ce-898b-99ba06c59cbb None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.269755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e851128-fc85-45ce-898b-99ba06c59cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.291097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5e851128-fc85-45ce-898b-99ba06c59cbb None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:47.291447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5e851128-fc85-45ce-898b-99ba06c59cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:47.332474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.334575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.345484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.371938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 337/660] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:47.371938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851128-fc85-45ce-898b-99ba06c59cbb None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.480918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 324/661] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:47.481934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.491578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e851128-fc85-45ce-898b-99ba06c59cbb None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.527626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.534127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.534840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.541168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.541168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.541168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:47.541168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.541168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.551506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 338/662] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:47.553500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.605769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.628748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386176d-f2f3-44e6-aefe-a45c7291c1f5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.668243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.669069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f98d3d-ed27-47e0-93d0-95c916114a12 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.669397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.669846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.670296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.678248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.679715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:47.694408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:47.695514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 325/663] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:47.696470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.716734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.718323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.718752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.719436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.734858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.736801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:47.753899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:47.754889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:47.755845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:47.755845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:47.755845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:47.755845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 339/664] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:47.755845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.807679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.818700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a68b1c-72f5-48b2-b260-53e7eaf2a979 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.859406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.860402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.861126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.861584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.869506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:47.871350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:47.874326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:47.881871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d363df-2915-4c5a-8eb3-e98468f26451 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:47.886634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:47.890705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 326/665] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:47.891716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:47.921337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:47.921970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:47.922238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:47.922509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:47.933051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:47.937673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:47.938801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:47.939836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:47.943648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 340/666] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:47.944508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.008905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7936f48-b549-43b3-b40e-ed7b73062cda None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.045760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.046354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.046632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.047035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.047585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:48.047939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.049349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.050022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb7dbb-2451-490e-8c80-14681a2e7e85 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.063084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 327/667] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:48.068859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.081394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:48.087546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.088245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.088525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.088801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.089562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:48.089860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.091247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.104561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 341/668] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:48.104561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.128320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:48.183120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642da38-8ac0-4942-99e8-923093e8abd6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.220112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.220733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.221008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.221276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.222017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:48.222321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.224602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.228683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c043e-5bee-40b5-955c-beb8207bbffb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.251216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 328/669] 10.222.0.45 () {56 vars in 1139 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:48.251216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.271674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.272308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.272696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.272967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.273619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:48.273920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.275396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.283989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 342/670] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:48.284788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.326857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:48.361591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0031e9-364e-40a9-89ad-5e8ba8c301d0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.369577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:48.393009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ff54-e411-475c-90f3-815c7a8f2272 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.398749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.399361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.399635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.399938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.400658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=1ce4f6719f9b47dda69cc67ed74b45f2) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:48.400960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.402397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.412555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 329/671] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/role_assignments?user.id=1ce4f6719f9b47dda69cc67ed74b45f2&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:48.413603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.460804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.462670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.463182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.463649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.476865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.479823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:48.500189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:48.501583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:48.502574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:48.511636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 343/672] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:48.512655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.548953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff268b9-b12c-4d6f-9fbb-6005bfc70f14 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.590778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:48.597300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.598116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.605208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.605208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.638630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e78f-e2c0-4fa1-b232-417f05d6a678 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.676330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.677740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.678159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.678680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.689894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.691396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.696037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.697670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.698555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:48.719263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:48.720503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:48.721558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:48.721558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:48.721558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:48.721558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 344/673] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:48.721558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.839740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 330/674] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:48.841136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.849948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbb381-d85a-4238-b56e-b61e9cfe07fb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.883321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:48.893961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:48.901826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:48.901826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:48.901826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:48.901826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:48.901826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:48.901826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:48.919589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 345/675] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:48.919589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:48.968678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ee786-d2f8-47a1-b5ad-67ef254492ca None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:48.984652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:49.016246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.016916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.017204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.017474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.018127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:49.018432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.019841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.032962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 331/676] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:49.033891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.048932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0dea2-511f-4ec8-bb90-3f64754e1a28 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.086669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.087301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.087577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.087848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.098256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.100015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:49.114529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:49.115547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:49.116464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:49.116464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:49.116464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:49.116464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 346/677] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:49.117231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.133518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:49.141913 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef7054-440b-462f-bc95-6abb8f8ae820 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.177904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfd63c-887a-4e7b-9699-d88d10a0931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.178514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd63c-887a-4e7b-9699-d88d10a0931a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.178848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd63c-887a-4e7b-9699-d88d10a0931a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.179108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfd63c-887a-4e7b-9699-d88d10a0931a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.179842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfd63c-887a-4e7b-9699-d88d10a0931a None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=2cc606d7aea34bf09af6ae2dd0f98902) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:49.180180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfd63c-887a-4e7b-9699-d88d10a0931a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.181615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfd63c-887a-4e7b-9699-d88d10a0931a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.194690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 332/678] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/role_assignments?user.id=2cc606d7aea34bf09af6ae2dd0f98902&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:49.194690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cacb2-34bb-4d60-9940-91dfe01bdc39 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.194690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cacb2-34bb-4d60-9940-91dfe01bdc39 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.195058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cacb2-34bb-4d60-9940-91dfe01bdc39 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.196565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 333/679] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:49.197444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cacb2-34bb-4d60-9940-91dfe01bdc39 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.252237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f29f3b-0651-40ca-9ef6-b7a0b2da5c59 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.253899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:49.293938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07744ae-5912-46e5-ba50-d21b09c32ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.294693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07744ae-5912-46e5-ba50-d21b09c32ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.295085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07744ae-5912-46e5-ba50-d21b09c32ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.295513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07744ae-5912-46e5-ba50-d21b09c32ae7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.304677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07744ae-5912-46e5-ba50-d21b09c32ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.306320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07744ae-5912-46e5-ba50-d21b09c32ae7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.317859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cacb2-34bb-4d60-9940-91dfe01bdc39 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-c07744ae-5912-46e5-ba50-d21b09c32ae7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:49.319875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:49.320841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:49.321811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 347/680] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:49.327128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853869e-2571-418a-a740-8841f4e78080 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.327417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853869e-2571-418a-a740-8841f4e78080 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.327683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853869e-2571-418a-a740-8841f4e78080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.348052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e853869e-2571-418a-a740-8841f4e78080 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:49.350299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e853869e-2571-418a-a740-8841f4e78080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:49.365161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.365977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.366258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.367714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.367714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:49.367714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.368922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.384308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 334/681] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:49.388539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.409927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:49.450903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 348/682] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:49.451836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853869e-2571-418a-a740-8841f4e78080 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.547313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5b492-a4fd-4226-9997-bddf953ab796 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.617619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.620433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.620901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.621975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.622876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:49.624896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.628903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.636147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:49.657757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 335/683] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:49.663763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.665208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853869e-2571-418a-a740-8841f4e78080 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.748540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.749182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.749468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.749722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.767303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.768865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.770217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:49.781230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:49.787485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 349/684] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:49.788680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.798170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048494-f588-47a4-b5a0-08730cd52d5f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.836853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.837459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.837733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.838000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.903331 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d24e75-bbea-48d1-93be-cd5891cdc937 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:49.919494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:49.921213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:49.938913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:49.939721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:49.940156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:49.940520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:49.953130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:49.959799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:49.960989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 350/685] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:49.962027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:49.986606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.007546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.039301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 336/686] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:50.040228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.079852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d3a0-dff7-487d-858a-e28d6d92d1cd None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.117692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.118745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.119237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.119801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.120736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:50.121284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.123091 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:50.141079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 351/687] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:50.141338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633935e9-fd5c-4ac3-a56f-09149159230b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.142447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.177250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.177941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.178322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.178621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.179311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:50.179623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.181054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:50.195137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 337/688] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:50.195137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.229037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.232274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.261880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdc34-e587-4c53-b7f1-2e501813a98c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.299143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.300144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.300561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72d26-6a49-4d71-8031-0b46ef0621c5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.300895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.301363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.318070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.319545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:50.340946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:50.342111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:50.343235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:50.343235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:50.343235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:50.347962 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 352/689] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:50.347962 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.354786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.355619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.356197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.356647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.357554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=3819d2b7da64494f9ed77f670b7c23c8) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:50.358088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.359943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:50.372320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 338/690] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/role_assignments?user.id=3819d2b7da64494f9ed77f670b7c23c8&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:50.374147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.485978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b74d1-f3aa-4c8e-8dcd-de1d7457bcfc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.549197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.560700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.561964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08e454-1485-442e-b81e-e8c71515dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.562419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e454-1485-442e-b81e-e8c71515dc67 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.562700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e454-1485-442e-b81e-e8c71515dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.564154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e454-1485-442e-b81e-e8c71515dc67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.565982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf2ab9-f815-40c2-be51-26a258d25495 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.574960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08e454-1485-442e-b81e-e8c71515dc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.576555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08e454-1485-442e-b81e-e8c71515dc67 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-ee08e454-1485-442e-b81e-e8c71515dc67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:50.595333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:50.596381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:50.597361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:50.597361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:50.597361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:50.597361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 353/691] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:50.597361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904262e1-ba1f-4ecf-a6c6-1774f0487098 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.597361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904262e1-ba1f-4ecf-a6c6-1774f0487098 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.597361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904262e1-ba1f-4ecf-a6c6-1774f0487098 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.597968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 354/692] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:50.604859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f758313-330d-4625-a988-dfb969d4df3f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.605240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f758313-330d-4625-a988-dfb969d4df3f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.605517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f758313-330d-4625-a988-dfb969d4df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.614142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.614861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.615188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.615469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.620477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:50.620791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.622253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:50.626579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8f758313-330d-4625-a988-dfb969d4df3f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:50.627779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8f758313-330d-4625-a988-dfb969d4df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:50.636003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 339/693] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:50.637079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.714593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 355/694] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:50.715700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f758313-330d-4625-a988-dfb969d4df3f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.805103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f055c-fc9f-447a-a90d-39575d0dd474 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.858522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.859054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.859328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.859596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.860270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:50.860621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.862008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:50.875079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 340/695] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:50.880354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:50.903392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.931623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f758313-330d-4625-a988-dfb969d4df3f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:50.940325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:50.979932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:50.979932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:50.979932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:50.979932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:50.983540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:50.985732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:51.001479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:51.002596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:51.003827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 356/696] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:51.008950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.013435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73525830-6da0-4f55-a86c-9992f108572d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.101397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.102476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.102855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.103230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.112832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.115195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.125522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd9d5-3be1-415a-8ffd-f4bda67021af None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:51.131687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:51.132857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:51.133824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:51.134549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 341/697] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:53:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:51.135046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.177053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.177745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.178027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.178302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.178997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:51.179301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.181189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.197696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 357/698] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:51.198697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.231581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:51.232660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:51.253284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12b3fc-7bae-4b65-909e-d4e769c22b5a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.290340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.291396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.291923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.292402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.304942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.306774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.322359 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb012-0363-410e-b683-dc068b0dd6be None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:51.323875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:51.324853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:51.325768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:51.325768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:51.325768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:51.328142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 342/699] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:51.329323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.368503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.369040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.369322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.369588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.370333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:51.370639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.372108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.391379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 358/700] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:53:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:51.392254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.446706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a001800-e5a3-4f31-942c-62fdec04c169 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.479312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:51.483079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:51.484330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b0363-0718-4365-b478-0bd8b3f018c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.484931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0363-0718-4365-b478-0bd8b3f018c9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.485210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0363-0718-4365-b478-0bd8b3f018c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.485481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b0363-0718-4365-b478-0bd8b3f018c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.486206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b0363-0718-4365-b478-0bd8b3f018c9 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=3101f5b8db404c0893687ad8cc51bb4b) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:51.486516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b0363-0718-4365-b478-0bd8b3f018c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.488048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b0363-0718-4365-b478-0bd8b3f018c9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.493944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 343/701] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:51 2022] GET /identity/v3/role_assignments?user.id=3101f5b8db404c0893687ad8cc51bb4b&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:51.495114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4307be-8cbd-473a-9591-24b273616c3d None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.495394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4307be-8cbd-473a-9591-24b273616c3d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.495668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4307be-8cbd-473a-9591-24b273616c3d None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.501118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 344/702] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:51.501118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4307be-8cbd-473a-9591-24b273616c3d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.512764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c05c90-932a-4cb1-89d5-c16e707899d3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.563214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccae8d-44a4-49ae-bc88-a741667ca3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.564428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccae8d-44a4-49ae-bc88-a741667ca3ee None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.565509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccae8d-44a4-49ae-bc88-a741667ca3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.566144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccae8d-44a4-49ae-bc88-a741667ca3ee None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.567120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccae8d-44a4-49ae-bc88-a741667ca3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:51.568221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccae8d-44a4-49ae-bc88-a741667ca3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.570653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccae8d-44a4-49ae-bc88-a741667ca3ee None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.589926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 359/703] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:51.592041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaccfa7-83be-464f-aa58-cbd75f81c3b5 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.592526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaccfa7-83be-464f-aa58-cbd75f81c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.593244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaccfa7-83be-464f-aa58-cbd75f81c3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.618146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1aaccfa7-83be-464f-aa58-cbd75f81c3b5 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:51.619750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1aaccfa7-83be-464f-aa58-cbd75f81c3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:51.630584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4307be-8cbd-473a-9591-24b273616c3d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.673342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.674375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.674660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.675098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.709538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 360/704] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:51.710194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaccfa7-83be-464f-aa58-cbd75f81c3b5 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.753085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:51.762311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.768291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:51.825925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:51.867799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaccfa7-83be-464f-aa58-cbd75f81c3b5 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:51.894673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 345/705] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:51.900698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:51.915685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:51.916434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:51.916786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:51.917133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:51.918268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:51.920131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.015350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:52.023953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 361/706] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:53:51 2022] POST /identity/v3/users => generated 254 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:52.023953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:52.026399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ef6ea-6032-4e53-801f-fec46a8b4234 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.076818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.077480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.077765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.078879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.091538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.093476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:52.112356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:52.113380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:52.114350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:52.114350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:52.114350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:52.114350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 346/707] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:52.121928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:52.247972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05c392-f590-457c-8fc9-821573fdc807 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.278689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c406c27-b424-4d94-9309-58a88eaacf29 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.295797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.296454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.297765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.297765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.297765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:52.297991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.299306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.317972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 347/708] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:52.318885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:52.319927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:52.326509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.327411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.327959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.328454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.329256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.330862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.341760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:52.343690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:52.344797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:53:52.345691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:52.348476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 362/709] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Aug 25 04:53:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:52.356225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:52.461449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec8115-7d2f-4622-8c7a-d1d331e16618 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.509467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b8692-d31e-446d-9e2d-48644606a2f4 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.515215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.515215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.515215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.515215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.523829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.526584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:52.543814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:52.544786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:52.545698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:52.548817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 348/710] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:52.554684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:52.561425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.562090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.562372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.562642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.563278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:52.563626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.565077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.571082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 363/711] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 25 04:53:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:52.576479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:52.629021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:52.641305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:52.665439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e0685-b917-4c40-949f-fbcc4dff4091 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.685847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4f731-53b9-4d9f-8acf-f1f0029c169a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.705597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34a821-cd4a-4517-b0d1-ba7a64c0321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.706083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a821-cd4a-4517-b0d1-ba7a64c0321b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.706450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a821-cd4a-4517-b0d1-ba7a64c0321b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.706797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34a821-cd4a-4517-b0d1-ba7a64c0321b None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.707638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34a821-cd4a-4517-b0d1-ba7a64c0321b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:52.708188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34a821-cd4a-4517-b0d1-ba7a64c0321b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.709805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34a821-cd4a-4517-b0d1-ba7a64c0321b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.722950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 349/712] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:52.727627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf7a65-f329-49c1-b033-161fcdf26873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.728498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf7a65-f329-49c1-b033-161fcdf26873 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.728953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf7a65-f329-49c1-b033-161fcdf26873 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.729108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfee80a-77d1-490b-bde9-1b3f35b4f194 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.729379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfee80a-77d1-490b-bde9-1b3f35b4f194 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.729714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfee80a-77d1-490b-bde9-1b3f35b4f194 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.729904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf7a65-f329-49c1-b033-161fcdf26873 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.730713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf7a65-f329-49c1-b033-161fcdf26873 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:52.731185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf7a65-f329-49c1-b033-161fcdf26873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.731296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 350/713] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:52.733149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfee80a-77d1-490b-bde9-1b3f35b4f194 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:52.733357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf7a65-f329-49c1-b033-161fcdf26873 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.740287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 364/714] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 25 04:53:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:52.747933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806c1d-5c24-48f9-996b-59602ce51a17 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.748779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806c1d-5c24-48f9-996b-59602ce51a17 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.749255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806c1d-5c24-48f9-996b-59602ce51a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.778195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-45806c1d-5c24-48f9-996b-59602ce51a17 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:52.779691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-45806c1d-5c24-48f9-996b-59602ce51a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:52.854014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfee80a-77d1-490b-bde9-1b3f35b4f194 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:52.888610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:52.901419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:52.902855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:52.906066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:52.906066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:52.906066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=89cfa7e2f08741d4938a017990b8b031) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:52.906066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:52.907715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:52.921110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 351/715] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:52 2022] GET /identity/v3/role_assignments?user.id=89cfa7e2f08741d4938a017990b8b031&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:52.931137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 365/716] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:53.244755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:53.366568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a3ca-cc4d-449b-9451-73a4ed3a6fc1 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:53.430468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:53.433287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:53.433850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:53.434273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] PATH_INFO: `/v3/services/network` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:53.435013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:53.437884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:53.460840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:53.467575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:53.468671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 352/717] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:53 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:53.469539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806c1d-5c24-48f9-996b-59602ce51a17 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:53.567421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:53.650803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806c1d-5c24-48f9-996b-59602ce51a17 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:53.725164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fdfeb-8c49-412f-ba88-85f18f5fd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:53.725785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fdfeb-8c49-412f-ba88-85f18f5fd95c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:53.726061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fdfeb-8c49-412f-ba88-85f18f5fd95c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:53.726340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fdfeb-8c49-412f-ba88-85f18f5fd95c None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:53.726973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fdfeb-8c49-412f-ba88-85f18f5fd95c None admin] RBAC: Adding query filter params (name=network) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:53.727277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fdfeb-8c49-412f-ba88-85f18f5fd95c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:53.728683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fdfeb-8c49-412f-ba88-85f18f5fd95c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:53.742585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 366/718] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:53:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:53.749419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:53.865823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:53.966128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24851d-8e46-45ce-ac63-56bc330f786e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:54.011392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348f53-a8cc-4611-bcda-79a8df25c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:54.012029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348f53-a8cc-4611-bcda-79a8df25c816 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:54.012305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348f53-a8cc-4611-bcda-79a8df25c816 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:54.012575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348f53-a8cc-4611-bcda-79a8df25c816 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:54.013198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348f53-a8cc-4611-bcda-79a8df25c816 None admin] RBAC: Adding query filter params (type=network) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:54.013500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348f53-a8cc-4611-bcda-79a8df25c816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:54.014881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348f53-a8cc-4611-bcda-79a8df25c816 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:54.030272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 353/719] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:53:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:54.047006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49fb34-46e1-4902-9f54-f448f1115ffa None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:54.047526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49fb34-46e1-4902-9f54-f448f1115ffa None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:54.047526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49fb34-46e1-4902-9f54-f448f1115ffa None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:54.049357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 367/720] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:54.055538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ae990-fb20-49bc-b015-26c4bbf75296 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:54.055864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ae990-fb20-49bc-b015-26c4bbf75296 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:54.056118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ae990-fb20-49bc-b015-26c4bbf75296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:54.087032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5b2ae990-fb20-49bc-b015-26c4bbf75296 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:54.088274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5b2ae990-fb20-49bc-b015-26c4bbf75296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:54.244768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 354/721] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:54.648259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49fb34-46e1-4902-9f54-f448f1115ffa None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:54.805607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49fb34-46e1-4902-9f54-f448f1115ffa None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:54.825752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:54.841096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22f68-b595-409a-bba7-036df240638f None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:54.841637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22f68-b595-409a-bba7-036df240638f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:54.841637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce22f68-b595-409a-bba7-036df240638f None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:54.843210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 355/722] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:54.850670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4be49-e3ba-4c79-a99e-cb809d6d189d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:54.851015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4be49-e3ba-4c79-a99e-cb809d6d189d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:54.851209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4be49-e3ba-4c79-a99e-cb809d6d189d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:54.857213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:54.857857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:54.858140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:54.859556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:54.881348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:54.882653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b1d4be49-e3ba-4c79-a99e-cb809d6d189d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:54.883876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b1d4be49-e3ba-4c79-a99e-cb809d6d189d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:54.888769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:54.889719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:54.890585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:54.893460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 368/723] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:54.904950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:54.988270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:55.027891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 356/724] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 04:53:55.055246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5343c9-a91a-4923-bc4e-0af132190620 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:55.101683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10aba8-d4a8-4384-9a56-eb0720db2e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:55.102661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10aba8-d4a8-4384-9a56-eb0720db2e33 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.103141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10aba8-d4a8-4384-9a56-eb0720db2e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.103630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10aba8-d4a8-4384-9a56-eb0720db2e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.104539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10aba8-d4a8-4384-9a56-eb0720db2e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:55.105041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10aba8-d4a8-4384-9a56-eb0720db2e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:55.106606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10aba8-d4a8-4384-9a56-eb0720db2e33 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:55.119772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 369/725] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:55.125185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4be49-e3ba-4c79-a99e-cb809d6d189d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:55.177506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bab23-2832-4a0a-9e79-9b29ad8888d9 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.178195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bab23-2832-4a0a-9e79-9b29ad8888d9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.178541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bab23-2832-4a0a-9e79-9b29ad8888d9 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.180309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 370/726] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:55.193036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614761-01b4-4186-a0a4-2e951953c989 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.193296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614761-01b4-4186-a0a4-2e951953c989 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.193721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614761-01b4-4186-a0a4-2e951953c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.231363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-6e614761-01b4-4186-a0a4-2e951953c989 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:55.232619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6e614761-01b4-4186-a0a4-2e951953c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:55.260682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4be49-e3ba-4c79-a99e-cb809d6d189d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:55.289194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:55.335172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:55.335820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.336126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.336398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.357893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:55.359380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:55.366553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 371/727] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:55.379028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:55.380201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:55.381118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:55.381118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:55.381118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:55.381118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 357/728] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:55.389246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e614761-01b4-4186-a0a4-2e951953c989 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:55.408034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:55.464735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:55.556467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e614761-01b4-4186-a0a4-2e951953c989 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:55.584809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1792ca9-4fd7-4ba5-8794-0488c240c8b2 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:55.591798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb742806-c8db-4eaa-9a5e-e11c31bf63b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:55.592515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742806-c8db-4eaa-9a5e-e11c31bf63b8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.592861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742806-c8db-4eaa-9a5e-e11c31bf63b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.593200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb742806-c8db-4eaa-9a5e-e11c31bf63b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.593911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742806-c8db-4eaa-9a5e-e11c31bf63b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:55.594344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742806-c8db-4eaa-9a5e-e11c31bf63b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:55.595884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb742806-c8db-4eaa-9a5e-e11c31bf63b8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:55.608541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 372/729] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:55.609928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565ed8-ebe5-4da2-9157-c2ee08c9e320 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.610337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565ed8-ebe5-4da2-9157-c2ee08c9e320 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.610714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565ed8-ebe5-4da2-9157-c2ee08c9e320 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.612396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 373/730] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:55.615097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565ed8-ebe5-4da2-9157-c2ee08c9e320 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:55.625017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb04aa-bfd4-4d91-ae43-65ea9d4edf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:55.625653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb04aa-bfd4-4d91-ae43-65ea9d4edf57 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.625935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb04aa-bfd4-4d91-ae43-65ea9d4edf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.626216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb04aa-bfd4-4d91-ae43-65ea9d4edf57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.637217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb04aa-bfd4-4d91-ae43-65ea9d4edf57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-07fb04aa-bfd4-4d91-ae43-65ea9d4edf57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:55.642254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:55.643184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:55.644080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 358/731] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:53:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:55.645230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24fb0-642d-4134-89e6-18f74b6461ec None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.645326 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24fb0-642d-4134-89e6-18f74b6461ec None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.647935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24fb0-642d-4134-89e6-18f74b6461ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.650805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:55.664866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f8e24fb0-642d-4134-89e6-18f74b6461ec None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:55.666257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f8e24fb0-642d-4134-89e6-18f74b6461ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:55.734651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565ed8-ebe5-4da2-9157-c2ee08c9e320 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:55.739772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 359/732] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:55.746650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24fb0-642d-4134-89e6-18f74b6461ec None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:55.771214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:55.772141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.772372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.772647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.780517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:55.780817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:55.781975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:55.793633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:55.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:53:55.795548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:55.799408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 374/733] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:55.800459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:55.889445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24fb0-642d-4134-89e6-18f74b6461ec None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:55.915480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:55.926103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:55.926924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.927282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.927627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.928413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:55.928793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:55.930276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:55.933485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d0d1e-4708-4641-bed3-d2ddd68c371b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:55.942006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 360/734] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:53:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:55.943825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:55.979129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:55.979932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:55.980338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:55.980686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:55.992362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:53:55.997355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:55.998318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:53:55.999167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:56.003671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 375/735] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:56.004636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.054236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:56.073087 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbdf50-e4e0-4a01-ac8b-37f0ea7ccc70 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.112016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d23a-944d-4927-9e58-d2725e696af9 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.115842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.116481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.116760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.117033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.117757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:56.118061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.119725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.143164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 361/736] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 25 04:53:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:56.143164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.152927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.153660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.153937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.154206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.166016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.167490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.176173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:56.184222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:56.186453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:56.187579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:56.187579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:56.187579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:56.190037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 376/737] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:56.191107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.256652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3f7d3-bc84-41c7-b634-f1af3788f1c3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.297396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.298006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.298293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.298568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.299240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:56.299548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.300967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.310081 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 362/738] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:56.310887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.314071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29909c59-42f6-465b-ac30-d7e76a54c7e6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.317777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:56.347671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.348306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.349194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.349722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.350356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.351712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.415392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69c86-7718-4bc4-883f-d4d9a362c0f8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.449217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20fb76-ae3f-4690-93f8-0ea27d0eb678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.449820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20fb76-ae3f-4690-93f8-0ea27d0eb678 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.450103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20fb76-ae3f-4690-93f8-0ea27d0eb678 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.450381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20fb76-ae3f-4690-93f8-0ea27d0eb678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.471811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 377/739] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:53:56 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:56.471811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.533667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20fb76-ae3f-4690-93f8-0ea27d0eb678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.535078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20fb76-ae3f-4690-93f8-0ea27d0eb678 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.538976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:56.581483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:56.644488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f30ee-c660-481e-969d-8b0f558210cc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.652259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 363/740] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 04:53:56.653847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745c92b-e332-4de4-8b50-54f38e9e78fd None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.654392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745c92b-e332-4de4-8b50-54f38e9e78fd None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.654680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745c92b-e332-4de4-8b50-54f38e9e78fd None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.656286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 364/741] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:56.657026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745c92b-e332-4de4-8b50-54f38e9e78fd None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.685141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.685756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.686031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.686299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.686942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:56.687246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.688651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.705208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 378/742] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:56.705208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.772617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745c92b-e332-4de4-8b50-54f38e9e78fd None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.775235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:56.808645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b074-6ea6-45f0-8c6c-5d338efab7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.809206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b074-6ea6-45f0-8c6c-5d338efab7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.809489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b074-6ea6-45f0-8c6c-5d338efab7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.809766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b074-6ea6-45f0-8c6c-5d338efab7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.815017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeca94-78bc-4360-a439-7eec27539994 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:56.820497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961b074-6ea6-45f0-8c6c-5d338efab7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.821970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961b074-6ea6-45f0-8c6c-5d338efab7f4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.832419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-d961b074-6ea6-45f0-8c6c-5d338efab7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:56.838537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:56.839493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:56.840441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:56.840441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:56.840441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:56.844057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 365/743] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:56.845855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab433bc-a265-4385-b0e7-f491c0929d9e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.847097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab433bc-a265-4385-b0e7-f491c0929d9e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.847097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab433bc-a265-4385-b0e7-f491c0929d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.853294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:56.853990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:56.854269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:56.854543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:56.865516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-8ab433bc-a265-4385-b0e7-f491c0929d9e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:56.866541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:56.866724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8ab433bc-a265-4385-b0e7-f491c0929d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:56.868067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:56.882529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:56.883545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:56.885023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:56.885023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:56.885023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:56.888375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 379/744] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:56.888977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:56.941953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 366/745] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 04:53:56.942871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab433bc-a265-4385-b0e7-f491c0929d9e None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.026661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f2493-5419-4736-b6fd-93368529652b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.045314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.061281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab433bc-a265-4385-b0e7-f491c0929d9e None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.062747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.063450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.063802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.064195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.072297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.073859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:57.086479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:57.087452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:57.088670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 380/746] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:57.089256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.096558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.097169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.097443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.097710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.098356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:57.099631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.101191 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.113234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 367/747] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:57.114094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.127212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.206562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ac478-1024-4125-9dac-54fb8014778b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.221123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802648f-7ead-4ec0-8735-f10a8b7398d5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.242911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.243514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.243797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.244081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.244722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:57.245031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.246399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.257610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.258425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.258850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 381/748] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:57.259077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.259551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.259654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.260641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:57.260964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.262404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.280850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 368/749] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:57.281564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.288382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.370025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.382393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f49c3-ad17-41fd-955a-09ed68417c63 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.392201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b31b6-3f8d-41d8-9e0b-a4ca1f8a7055 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.418167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.418801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.419082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.421772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.426618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.428269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.430164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.430942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.431223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.431496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.432170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.433585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:53:57.440085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:57.441119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:53:57.442063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:57.446451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 382/750] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:57.447172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.509978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 369/751] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:53:57 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:53:57.510713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.572571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71502a-8db9-4e71-bfe0-6ed1f909e976 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.612132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.625956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.625956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.625956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.625956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.630814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.632813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:57.646707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:57.647677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:57.648905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:57.655744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 383/752] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:57.657017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.659588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182da5-840e-411d-913a-52af4d21a2cf None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.662900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.713543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.714155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.714429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.714699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.779284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309dd23-e486-4fd9-8f12-3d19b4708bb8 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:57.804275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.806470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.813936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:57.814622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:57.814963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:57.815299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:57.816142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:57.816515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:57.818646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:57.838070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 384/753] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:57.839067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.897017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.910260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:57.936666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 370/754] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:53:57.936666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:57.968852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac90dfa-7dea-4b03-901d-cc2594afa34d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.020610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.021921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.022349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.022765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.024047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:58.024753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.026579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.048163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de73fb3-a1c7-4878-a956-87e149e9ba0e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.049001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 385/755] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:58.050057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.083247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.084279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.084460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.084820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.095656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.097285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:58.121764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:58.123963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:58.126017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:58.126017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:58.126017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:58.127651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 371/756] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:58.129257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.188470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:58.197507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf746aa-f9a0-49d3-b148-c72b6c3ddb36 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.238013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:58.257200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.258484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.259128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.259765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.277948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.280750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:53:58.302896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:58.304129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:53:58.305228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:53:58.305228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:53:58.305228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:58.310979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09f36c-9581-4546-84bb-8f553d0286fe None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.311329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 386/757] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:58.312376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.344243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.345050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.345430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.345804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.346634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=3101f5b8db404c0893687ad8cc51bb4b) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:58.347044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.348682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.361819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 372/758] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/role_assignments?user.id=3101f5b8db404c0893687ad8cc51bb4b&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:58.361819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.460970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:58.476878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f7c05-62df-43e0-a2a4-c1aa8de7a552 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.484214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409aaa1-10a1-4dad-81b7-deee0c0bf470 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.523782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a9bb6-4a0a-42de-b761-6dc34ca88311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.524609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a9bb6-4a0a-42de-b761-6dc34ca88311 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.524979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a9bb6-4a0a-42de-b761-6dc34ca88311 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.525324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a9bb6-4a0a-42de-b761-6dc34ca88311 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.526051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a9bb6-4a0a-42de-b761-6dc34ca88311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:58.526484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a9bb6-4a0a-42de-b761-6dc34ca88311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.528163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a9bb6-4a0a-42de-b761-6dc34ca88311 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.533773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f480d-0e8b-4b51-8c14-15777ea6a5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.534403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f480d-0e8b-4b51-8c14-15777ea6a5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.534683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f480d-0e8b-4b51-8c14-15777ea6a5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.534962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f480d-0e8b-4b51-8c14-15777ea6a5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.535617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f480d-0e8b-4b51-8c14-15777ea6a5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:58.535998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f480d-0e8b-4b51-8c14-15777ea6a5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.538295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f480d-0e8b-4b51-8c14-15777ea6a5b2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.542663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 387/759] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:58.544171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da2653-f397-4067-8496-267c22aa9d71 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.544527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da2653-f397-4067-8496-267c22aa9d71 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.544874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da2653-f397-4067-8496-267c22aa9d71 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.546919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 388/760] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:53:58.548683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da2653-f397-4067-8496-267c22aa9d71 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.559509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 373/761] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:58.560891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bdd2f-12a4-49a2-b3c5-1c8ee01ae8da None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.561177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bdd2f-12a4-49a2-b3c5-1c8ee01ae8da None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.561453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bdd2f-12a4-49a2-b3c5-1c8ee01ae8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.582822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-672bdd2f-12a4-49a2-b3c5-1c8ee01ae8da None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:58.584137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-672bdd2f-12a4-49a2-b3c5-1c8ee01ae8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:58.590781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:58.669898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da2653-f397-4067-8496-267c22aa9d71 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.685890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 374/762] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:53:58.686868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bdd2f-12a4-49a2-b3c5-1c8ee01ae8da None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.734781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.735419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.735696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.736355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.747182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.749282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:58.777683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:58.778635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:58.779533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 389/763] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:53:58.785681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.825357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:58.878196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bdd2f-12a4-49a2-b3c5-1c8ee01ae8da None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:58.923055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:58.923689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:58.923985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:58.924258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:58.943557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:58.945080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:53:58.965608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:58.966538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:53:58.967444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 375/764] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:58.974132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:58.980299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:58.985862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123b660-bea0-4f0f-9fe4-d5b321ecefad None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:59.045100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:59.046242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.046520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.046791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.047483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:59.048284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:59.050183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:59.067423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 390/765] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:59.068663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:59.131579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a262359-808a-49a0-b339-6d29de166831 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:59.172271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:59.180366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:59.181116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.187651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.187651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.187651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:59.187651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:59.187651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:59.204339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b521-7169-4bcd-bb73-702743565fda None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:59.208023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 376/766] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:59.209838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:59.253764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:59.255573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.256060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.256478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.257214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:59.258750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:53:59.270056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:53:59.271855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:53:59.272727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:53:59.275346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 391/767] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Aug 25 04:53:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:53:59.276488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:59.299893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:59.350073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f93c1-085b-4fc4-8323-9486786ded43 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:59.394886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a9ec0-fa73-47ab-a7c8-a06f8f125e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:59.396624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9ec0-fa73-47ab-a7c8-a06f8f125e62 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.397935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68938-a5c0-4f83-9a59-78f839a8e7a3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:59.398367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9ec0-fa73-47ab-a7c8-a06f8f125e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.398807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a9ec0-fa73-47ab-a7c8-a06f8f125e62 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/89cfa7e2f08741d4938a017990b8b031/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.403048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a9ec0-fa73-47ab-a7c8-a06f8f125e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=89cfa7e2f08741d4938a017990b8b031, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:59.404674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a9ec0-fa73-47ab-a7c8-a06f8f125e62 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:59.437888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:59.438505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.438785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.439060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.439797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=6e73a2cbe56e4cc7b8d52e53300bd809) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:59.440138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:59.441593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:59.455931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 392/768] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:53:59 2022] GET /identity/v3/role_assignments?user.id=6e73a2cbe56e4cc7b8d52e53300bd809&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:59.455931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:59.523368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 377/769] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:53:59 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/89cfa7e2f08741d4938a017990b8b031/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:53:59.565338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:59.586814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed661-e6e3-4555-a3e0-fcda95077789 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.587095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed661-e6e3-4555-a3e0-fcda95077789 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.587370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ed661-e6e3-4555-a3e0-fcda95077789 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.589022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 378/770] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:53:59.589892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ff57d-9b62-4eed-bf43-bac207f5d685 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:59.594694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2f6b1-31a0-4d34-9bb8-799a07fa2059 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.595061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2f6b1-31a0-4d34-9bb8-799a07fa2059 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.595277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2f6b1-31a0-4d34-9bb8-799a07fa2059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.617772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-80b2f6b1-31a0-4d34-9bb8-799a07fa2059 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:53:59.621044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-80b2f6b1-31a0-4d34-9bb8-799a07fa2059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:53:59.663684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:59.664453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.664738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.665031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.665658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:59.665965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:59.667386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:59.680366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:53:59.689963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 393/771] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 25 04:53:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:53:59.696222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:53:59.708547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 379/772] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:53:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:53:59.825036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcf666-1f98-4b85-9e04-230897c43412 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:53:59.861087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:53:59.861693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:53:59.861968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:53:59.862236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:53:59.862870 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:53:59.863168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:53:59.865184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:53:59.870523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 394/773] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 25 04:53:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:53:59.876010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2f6b1-31a0-4d34-9bb8-799a07fa2059 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:00.012896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2f6b1-31a0-4d34-9bb8-799a07fa2059 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:00.055062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:00.069914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:00.075423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:00.076022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.076298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.076562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.077416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] RBAC: Adding query filter params (interface=public, service_id=a8818f83bbac46b5a6acfffec56dfb9a, region_id=RegionOne) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:00.077786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:00.079460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:00.094116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 380/774] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:53:59 2022] GET /identity/v3/endpoints?service_id=a8818f83bbac46b5a6acfffec56dfb9a&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:00.099173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:00.151093 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:00.208644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6350c-1e7d-4422-80b8-548d298919a0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:00.266034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee380b2-fa11-4b8c-a405-10c54cb541a8 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:00.277679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:00.278341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.278619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.278889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.279495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:00.280892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:00.293591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 381/775] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:00 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:00.343400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8cd4-cdab-4abd-b66c-d81926d4e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:00.344023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8cd4-cdab-4abd-b66c-d81926d4e49d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.344311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8cd4-cdab-4abd-b66c-d81926d4e49d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.344584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8cd4-cdab-4abd-b66c-d81926d4e49d None admin] PATH_INFO: `/v3/services/network` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.345180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8cd4-cdab-4abd-b66c-d81926d4e49d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:00.346586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8cd4-cdab-4abd-b66c-d81926d4e49d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-85cc8cd4-cdab-4abd-b66c-d81926d4e49d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:00.360914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:00.361967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:00.362798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 395/776] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:00 2022] GET /identity/v3/services/network => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:00.371765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:00.460168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666010-cacb-4141-93a9-01dddcbb3b86 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.460492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666010-cacb-4141-93a9-01dddcbb3b86 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.460717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666010-cacb-4141-93a9-01dddcbb3b86 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.462395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 396/777] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:00.468079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c391c-081b-472a-b39f-11896d79725b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.468446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c391c-081b-472a-b39f-11896d79725b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.468784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c391c-081b-472a-b39f-11896d79725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.491578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-100c391c-081b-472a-b39f-11896d79725b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:00.493410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-100c391c-081b-472a-b39f-11896d79725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:00.519602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ed1b0-4a1c-4c26-8526-af4ff7f2f7cc None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:00.531394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:00.568984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:00.569874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.570541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.570818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.571724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] RBAC: Adding query filter params (name=network) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:00.572057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:00.573719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:00.579969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 397/778] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:00.580457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 382/779] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:00.586357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c391c-081b-472a-b39f-11896d79725b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:00.589939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:00.691769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c391c-081b-472a-b39f-11896d79725b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:00.728620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:00.729288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.729576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.729852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.730493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:00.730800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:00.732201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:00.737657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 398/780] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:00.744160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:00.891635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72433-300b-46ee-af33-a7bfe1ac470e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:00.936390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:00.937037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:00.937321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:00.937596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:00.938336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] RBAC: Adding query filter params (interface=public, service_id=0a3cc22a39e446148e13c150385f4e92, region_id=RegionOne) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:00.938651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:00.940123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:00.952350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 383/781] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:54:00 2022] GET /identity/v3/endpoints?service_id=0a3cc22a39e446148e13c150385f4e92&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:00.957588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:01.050161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:01.052227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:01.120074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e49eea-4109-4c12-a46a-9907519f40e6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:01.120762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:01.184025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:01.184635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:01.184914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:01.185187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:01.185793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:01.187177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:01.196107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 399/782] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:00 2022] GET /identity/v3/services => generated 772 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:01.226237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecc96a-6f26-4863-9a84-a794e05238fa None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:01.279754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:01.280446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:01.280783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:01.281057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:01.299536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:01.306494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:01.307511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:01.308857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 384/783] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:01.315832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:01.444986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a84e0a-b016-4477-9124-7d95be339e64 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:01.478838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:01.484379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:01.484999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:01.485285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:01.485556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:01.486231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:01.486536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:01.487935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:01.497011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 400/784] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:54:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:01.502807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:01.806429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:01.812500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c07464-7571-4d6c-9217-0c911f756b91 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:01.869298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbda2f4-2d58-4822-98ed-7f5e4a59c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:01.869944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda2f4-2d58-4822-98ed-7f5e4a59c475 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:01.870220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda2f4-2d58-4822-98ed-7f5e4a59c475 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:01.870491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda2f4-2d58-4822-98ed-7f5e4a59c475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:01.883539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbda2f4-2d58-4822-98ed-7f5e4a59c475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:01.885039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbda2f4-2d58-4822-98ed-7f5e4a59c475 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-7cbda2f4-2d58-4822-98ed-7f5e4a59c475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:01.907720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:01.908801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:01.910377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:01.910377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:01.910377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:01.910377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 385/785] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:01.915382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:02.021756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43deed8-b548-437f-9b1a-93ef1789942c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.022104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43deed8-b548-437f-9b1a-93ef1789942c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.022303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43deed8-b548-437f-9b1a-93ef1789942c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.023896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 386/786] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:02.037501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606cf83-08e5-4303-b9e7-b371ee327c1d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.037775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606cf83-08e5-4303-b9e7-b371ee327c1d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.038047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606cf83-08e5-4303-b9e7-b371ee327c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.074444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5606cf83-08e5-4303-b9e7-b371ee327c1d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:02.075584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5606cf83-08e5-4303-b9e7-b371ee327c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:02.090407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de3ac8-7d1a-4250-8c60-0f6612daccdc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:02.130937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce298d-c014-462d-b031-6389c2e36e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:02.131968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce298d-c014-462d-b031-6389c2e36e98 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.132451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce298d-c014-462d-b031-6389c2e36e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.132926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce298d-c014-462d-b031-6389c2e36e98 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.133770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce298d-c014-462d-b031-6389c2e36e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:02.134272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce298d-c014-462d-b031-6389c2e36e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:02.135895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce298d-c014-462d-b031-6389c2e36e98 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:02.150472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 401/787] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:02.152144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2a69a-113d-454c-9e4d-1b7867d3e277 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.152631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2a69a-113d-454c-9e4d-1b7867d3e277 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.153123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2a69a-113d-454c-9e4d-1b7867d3e277 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.158949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 402/788] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:02.159952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2a69a-113d-454c-9e4d-1b7867d3e277 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:02.172669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 387/789] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:02.176932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe451b59-6fdc-4dc0-be77-053f2b6ac139 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.178117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe451b59-6fdc-4dc0-be77-053f2b6ac139 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.178776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe451b59-6fdc-4dc0-be77-053f2b6ac139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.209207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-fe451b59-6fdc-4dc0-be77-053f2b6ac139 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:02.211372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fe451b59-6fdc-4dc0-be77-053f2b6ac139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:02.259039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:02.330905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 388/790] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:02.338843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2a69a-113d-454c-9e4d-1b7867d3e277 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:02.408527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:02.409429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.409940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.410419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.425690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:02.428197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:02.446166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:02.447239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:54:02.448244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:02.452385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 403/791] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:02.458611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe451b59-6fdc-4dc0-be77-053f2b6ac139 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:02.482188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:02.575343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:02.615247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe451b59-6fdc-4dc0-be77-053f2b6ac139 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:02.674343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1166174-7446-48e6-8859-d5685088491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:02.674978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1166174-7446-48e6-8859-d5685088491d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.675254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1166174-7446-48e6-8859-d5685088491d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.675527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1166174-7446-48e6-8859-d5685088491d None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.676361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1166174-7446-48e6-8859-d5685088491d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:02.676800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1166174-7446-48e6-8859-d5685088491d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:02.678497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1166174-7446-48e6-8859-d5685088491d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:02.702049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 389/792] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 25 04:54:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:02.707340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1166174-7446-48e6-8859-d5685088491d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:02.724346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59ee24-d48f-4b7e-96ba-637d3ed5730c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:02.740304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:02.769448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:02.770800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.771605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.771883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.778362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:02.792744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:02.799791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:02.802702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:02.803734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:02.805575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 404/793] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:02.807379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:02.820730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1166174-7446-48e6-8859-d5685088491d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:02.858053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:02.858268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.858637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.859001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.870524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:02.875345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:02.876344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:02.877199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 390/794] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:54:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:02.877896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:02.937565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9831-229b-4d97-89c3-1a453f045f34 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:02.976148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:02.976776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:02.977044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:02.977311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:02.987507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf3bc3-161d-4fa3-a0a8-755797ffcbfe None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:02.988134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:02.990244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:03.005571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:03.006730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:03.007660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:03.007660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:03.007660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:03.007660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 405/795] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:03.007660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.021815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.030241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ff834-9c7c-4c4e-8d53-17d7cf10cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.030853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff834-9c7c-4c4e-8d53-17d7cf10cd45 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.031135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff834-9c7c-4c4e-8d53-17d7cf10cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.031805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff834-9c7c-4c4e-8d53-17d7cf10cd45 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.032113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ff834-9c7c-4c4e-8d53-17d7cf10cd45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:03.032418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ff834-9c7c-4c4e-8d53-17d7cf10cd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.033797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ff834-9c7c-4c4e-8d53-17d7cf10cd45 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.038109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.047495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 391/796] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:54:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:03.048832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ce16-bd1e-4657-82ac-8d466ed158c3 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.049131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ce16-bd1e-4657-82ac-8d466ed158c3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.049443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3ce16-bd1e-4657-82ac-8d466ed158c3 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.051018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 392/797] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:03.052874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3ce16-bd1e-4657-82ac-8d466ed158c3 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.128180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996944bf-dc70-4e62-a61e-25a8b5bfdb9e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.171806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.172442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.172868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.173133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.173799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:03.174101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.175473 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.178749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3ce16-bd1e-4657-82ac-8d466ed158c3 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.184276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 406/798] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:03.184937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.222896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca451f-8af2-42d3-80fa-738dc0ba9338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.224353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca451f-8af2-42d3-80fa-738dc0ba9338 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.224909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca451f-8af2-42d3-80fa-738dc0ba9338 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.225187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca451f-8af2-42d3-80fa-738dc0ba9338 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.225871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca451f-8af2-42d3-80fa-738dc0ba9338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:03.226179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca451f-8af2-42d3-80fa-738dc0ba9338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.227604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca451f-8af2-42d3-80fa-738dc0ba9338 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.246342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 393/799] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:03.246342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee123e-8a47-4a05-96f7-bc4fd35e1dc8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.246342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee123e-8a47-4a05-96f7-bc4fd35e1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.246342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee123e-8a47-4a05-96f7-bc4fd35e1dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.264746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-80ee123e-8a47-4a05-96f7-bc4fd35e1dc8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:03.265989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-80ee123e-8a47-4a05-96f7-bc4fd35e1dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:03.317553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.342380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 394/800] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:03.352581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee123e-8a47-4a05-96f7-bc4fd35e1dc8 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.405255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.418941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f79995-1ad9-449e-9bb6-5b73d7e7b07f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.471367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.472768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.473896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.474943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.481689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee123e-8a47-4a05-96f7-bc4fd35e1dc8 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.492289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.495013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:03.515728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:03.516826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:03.517799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:03.517799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:03.517799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:03.517968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 407/801] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:03.518656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.530286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.531277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.531793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.532284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.547171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.549478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:03.566977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:03.568537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:03.570203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:03.570203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:03.570203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:03.570203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 395/802] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:03.570203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.602171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.635090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e86134-a0b3-498e-b1b0-6d0110d7d4c9 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.669114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6311f3c-f57c-40e9-9f64-2e9dfae4e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.669663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311f3c-f57c-40e9-9f64-2e9dfae4e85c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.669937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311f3c-f57c-40e9-9f64-2e9dfae4e85c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.670205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6311f3c-f57c-40e9-9f64-2e9dfae4e85c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.677281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6311f3c-f57c-40e9-9f64-2e9dfae4e85c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.678560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2c02e-6cf5-4a5f-84b2-8d7936fc454f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.678726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6311f3c-f57c-40e9-9f64-2e9dfae4e85c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.681615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-b6311f3c-f57c-40e9-9f64-2e9dfae4e85c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:03.690751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:03.702897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 408/803] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea108-1964-440e-bd5f-812f5d352727 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.703803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea108-1964-440e-bd5f-812f5d352727 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.704435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbea108-1964-440e-bd5f-812f5d352727 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.704435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 409/804] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:03.704435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbea108-1964-440e-bd5f-812f5d352727 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.720176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.720785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.721059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.721328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.721964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:03.722267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.723829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.735718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 396/805] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:03.736548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.800782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbea108-1964-440e-bd5f-812f5d352727 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.833766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.834837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.835438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.835776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.836016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.836652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:03.836953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.838321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.844101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf5e1d-c592-49d1-ac39-c9763541510e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.849799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 410/806] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:03.850604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.880968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b202e8c-b995-45be-baaa-c99bd6016c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.881713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b202e8c-b995-45be-baaa-c99bd6016c69 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.882065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b202e8c-b995-45be-baaa-c99bd6016c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.882407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b202e8c-b995-45be-baaa-c99bd6016c69 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.883056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b202e8c-b995-45be-baaa-c99bd6016c69 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.884536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b202e8c-b995-45be-baaa-c99bd6016c69 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-1b202e8c-b995-45be-baaa-c99bd6016c69 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:03.893163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:03.894370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:03.895499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 397/807] 10.222.0.45 () {56 vars in 1129 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:03.896623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9256b27-2d64-4140-98df-54f67654efa6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.896623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9256b27-2d64-4140-98df-54f67654efa6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.896623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9256b27-2d64-4140-98df-54f67654efa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.913163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:03.914084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b9256b27-2d64-4140-98df-54f67654efa6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:03.915277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b9256b27-2d64-4140-98df-54f67654efa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:03.955605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bc384-b697-4427-8571-001f76975bf6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:03.982300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 398/808] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:03.983212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9256b27-2d64-4140-98df-54f67654efa6 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:03.989932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:03.990711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:03.991158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:03.991592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:03.992375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:03.992687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:03.994119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.011134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 411/809] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:04.011134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.071424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.086764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9256b27-2d64-4140-98df-54f67654efa6 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.115772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0e6e9-5529-4a43-b11d-9d2a3d2a43d6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.121787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.122421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.122701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.122976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.131030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.132511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.137660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:04.143886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:04.152118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 399/810] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:54:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:04.153344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.162567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.163312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.163675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.164000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.171571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.173046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:04.185243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:04.186228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 412/811] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:04.187199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.262178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b654e75-9f90-4fab-b9a8-341530a8b46f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.292208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd833173-b13d-4a80-b624-410a914d1d29 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.295479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.296113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.296392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.296661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.297285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:04.297585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.298959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.303462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 400/812] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:04.304483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.316057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.325705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.326367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.326644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.326915 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/3101f5b8db404c0893687ad8cc51bb4b/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.328972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=3101f5b8db404c0893687ad8cc51bb4b, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.330324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.402831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658fbff-f8a9-4434-9c56-5f47f416a0eb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.429191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 413/813] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:54:04 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/3101f5b8db404c0893687ad8cc51bb4b/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:54:04.430119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.435862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.436517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.436791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.437057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.437873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:04.438178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.439689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.466039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 401/814] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:04.466039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.489355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.538170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.554786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0be176-f021-40eb-b4a4-ed0a7cfaf6e6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.584569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e57607-8fed-4fc4-8441-bf3351e32349 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.601575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.602223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.602465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.602737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.603803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:04.603803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.605213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.623386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 414/815] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:04.624238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.625489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.626347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.626897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.627266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] PATH_INFO: `/v3/services/network` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.627987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.630045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:04.639644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:04.640964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 04:54:04.641988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:04.643366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 402/816] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:04.644721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.742000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.745885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932ee3b-cc4a-4914-a866-8396730cfb15 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.762080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e895a68-d27d-4f5a-a836-89954f7c9c20 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.779713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.780355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.780636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.780906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.781545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:04.781849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.783213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.793282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 415/817] 10.222.0.45 () {56 vars in 1124 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:04.793282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.798653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.806586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.807198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.807483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.807756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.882700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.884210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.897932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ab49b-75c1-4675-9b51-3e8e57654562 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:04.933834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:04.934462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:04.934734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:04.934994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:04.945541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:04.946983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:04.961998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:04.962953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:04.964376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:04.964376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:04.964376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:04.967989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 416/818] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:04.968908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:04.985097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:04.996182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 403/819] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:54:04.997184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.029482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:05.079364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec11029-bc9b-436b-ae3f-bbb8a5dacd5d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.103463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b138d-5e6f-4423-af8f-6b58683842dd None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.116282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.116881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.117162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.117435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.118063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] RBAC: Adding query filter params (name=network) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:05.118363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.119735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.127954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 417/820] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:05.127954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.144828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.145481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.145756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.146020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.146666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.148176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.205413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:05.226771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c9e6c-7100-4ed1-a4f1-83c7ec98ebeb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.260174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.260775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.261055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.261326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.261969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:05.262270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.263653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.274949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 418/821] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:05.283933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.284509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 404/822] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:05.285777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.412545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:05.437349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0633c7-7ff4-45bd-8fed-cc38daa8f2da None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.437731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b4ad-0d8a-49db-a2af-ffe701c63c41 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.484664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.485511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.485895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.486172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.489481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.490110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.490492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.491643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.491643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] RBAC: Adding query filter params (type=network) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:05.491936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.493263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.497155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:05.499010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 405/823] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:05.500040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.501879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.503849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:05.521854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:05.523062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:05.524173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:05.524173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:05.524173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:05.526056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 419/824] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:05.527925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.617250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19bc7b-8cbd-4937-b3cb-b7f79186cd8c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.653864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.654510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.654788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.655061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.662314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.663818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.665895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a762375-92f1-4b69-b3f7-4c783071ebf1 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:05.675402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:05.676384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 406/825] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:05.678001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.693433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:05.718542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.719190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.719471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.719745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.720617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.721830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.797922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4aff5f-4443-4462-9f65-78c4d1869d4f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:05.823607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 420/826] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:05 2022] POST /identity/v3/endpoints => generated 337 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:05.824515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.865212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:05.866318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:05.866807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:05.867448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:05.868541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:05.869115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:05.871097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:05.891471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:05.903597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 407/827] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:05.909293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:05.963098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638226b7-e7f9-4e78-a362-eb772187222a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:06.021143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:06.022070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:06.022350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:06.022623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:06.023590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:06.023918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:06.025997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:06.042781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:06.044496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 421/828] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:06.049420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:06.092835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814ffd-3ec3-491b-a66a-dadbcb528433 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:06.153696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:06.154319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:06.154603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:06.154877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:06.163278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:06.165304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:06.179332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:06.180351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:06.181381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 408/829] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:06.186500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:06.202690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465d66d-3e34-4018-adbb-0e26623f36ec None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:06.213090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:06.251757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:06.252484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:06.252774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:06.253597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/6e73a2cbe56e4cc7b8d52e53300bd809/roles/0906f5915c62440697970a4f9c746228` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:06.275970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=6e73a2cbe56e4cc7b8d52e53300bd809, role_id=0906f5915c62440697970a4f9c746228)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:06.277437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:06.307549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d1e43-f2bd-49ee-b662-b3fde6d68e4a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:06.331799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:06.344588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bee4e8-fdfc-4bf0-abbb-f9df78f96e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:06.345205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee4e8-fdfc-4bf0-abbb-f9df78f96e24 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:06.345480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee4e8-fdfc-4bf0-abbb-f9df78f96e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:06.345747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bee4e8-fdfc-4bf0-abbb-f9df78f96e24 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:06.346453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bee4e8-fdfc-4bf0-abbb-f9df78f96e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:06.346765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bee4e8-fdfc-4bf0-abbb-f9df78f96e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:06.348298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bee4e8-fdfc-4bf0-abbb-f9df78f96e24 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:06.353754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 422/830] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:54:06 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/6e73a2cbe56e4cc7b8d52e53300bd809/roles/0906f5915c62440697970a4f9c746228 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:54:06.367952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 409/831] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:06.374571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:06.498463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f157072-fe4f-48f4-97e9-8886b3381c0c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:06.510741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e84c0-eb2c-4756-9499-094f5e97111b None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:06.511253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e84c0-eb2c-4756-9499-094f5e97111b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:06.511253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e84c0-eb2c-4756-9499-094f5e97111b None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:06.512984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 410/832] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:06.518910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc4e3-33ad-47ea-b57c-d575d892eb26 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:06.519234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc4e3-33ad-47ea-b57c-d575d892eb26 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:06.519452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bc4e3-33ad-47ea-b57c-d575d892eb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:06.541765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:06.542265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-201bc4e3-33ad-47ea-b57c-d575d892eb26 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:06.542380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:06.542645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:06.542925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:06.543465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-201bc4e3-33ad-47ea-b57c-d575d892eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:06.543669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=89cfa7e2f08741d4938a017990b8b031) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:06.544009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:06.545634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:06.554248 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 423/833] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:06 2022] GET /identity/v3/role_assignments?user.id=89cfa7e2f08741d4938a017990b8b031&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:06.637860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 411/834] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:06.919027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:06.944017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:07.028191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13733-efca-4015-a14e-c208244da6a9 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:07.065720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:07.067319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.067823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.068520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.079499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:07.084886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:07.085825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:07.086707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:07.093854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 424/835] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:07.095493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bc4e3-33ad-47ea-b57c-d575d892eb26 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:07.202244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bc4e3-33ad-47ea-b57c-d575d892eb26 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:07.216269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:07.239663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be53b17-963f-4d6b-99a7-7e23bf91d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:07.240697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53b17-963f-4d6b-99a7-7e23bf91d850 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.241200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53b17-963f-4d6b-99a7-7e23bf91d850 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.241684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be53b17-963f-4d6b-99a7-7e23bf91d850 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.242603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be53b17-963f-4d6b-99a7-7e23bf91d850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:07.243114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be53b17-963f-4d6b-99a7-7e23bf91d850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:07.244871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be53b17-963f-4d6b-99a7-7e23bf91d850 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:07.254152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 412/836] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:07.261012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:07.354220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:07.377420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6afc4a-c483-4835-a4b5-58cb8fdc0563 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:07.383327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ed73-7fe8-42d7-a077-4a23ec89b15e None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.383611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ed73-7fe8-42d7-a077-4a23ec89b15e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.383894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ed73-7fe8-42d7-a077-4a23ec89b15e None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.385601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 413/837] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:07.391532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bc7f9-da7d-40aa-a8cf-0f3d933eddd8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.391816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bc7f9-da7d-40aa-a8cf-0f3d933eddd8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.392132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bc7f9-da7d-40aa-a8cf-0f3d933eddd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.413031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4a3bc7f9-da7d-40aa-a8cf-0f3d933eddd8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:07.413377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:07.414004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.414271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4a3bc7f9-da7d-40aa-a8cf-0f3d933eddd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:07.414400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.414558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.425120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:07.427349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:07.442177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:07.443193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:07.444135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:07.444135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:07.444135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:07.444135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 425/838] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:07.450109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:07.504584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 414/839] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:07.561694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2c76f-36f3-4ad0-9525-f6d531ec0eef None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:07.592274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:07.597005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:07.597607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.597879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.598283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.599039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:07.599402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:07.601054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:07.613299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 426/840] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:07.619885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bc7f9-da7d-40aa-a8cf-0f3d933eddd8 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:07.721349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bc7f9-da7d-40aa-a8cf-0f3d933eddd8 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:07.736458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:07.761989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:07.761989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.761989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.761989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.766647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:07.768121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:07.780419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:07.782638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:07.784458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 415/841] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:07.788217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:07.799772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:07.905122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce689eb-b8ef-40c8-b8fe-e5c22faa9d9e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:07.926374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e41b1-478a-45f5-94c9-3c5a2a172f03 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:07.949993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:07.951097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.951386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.951960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.952711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:07.953242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:07.955821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:07.965782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:07.966654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:07.966998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:07.968159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:07.968828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:07.970274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:07.981252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:07.983746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:07.985824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:07.987333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 427/842] 10.222.0.45 () {56 vars in 1135 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:07.987333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:07.992127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 416/843] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:07.992127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.024921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:08.051956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:08.119947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb3a2-d288-4bcb-8d3b-29eb32589836 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:08.120786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b95455-a3e0-467b-ac2e-53f1d7d6fe24 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:08.162380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:08.163236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.163654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.164096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.164860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:08.165049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:08.165484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:08.165866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.166300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.166676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.167463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:08.178862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 417/844] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:08.182679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.256374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:08.258230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:08.289340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:08.298681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc879-eb74-448c-8aca-ae4bffcb8f18 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:08.312046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:08.338278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d3782-c4da-4c33-a4cf-31af4edd23a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:08.339066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d3782-c4da-4c33-a4cf-31af4edd23a1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.339447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d3782-c4da-4c33-a4cf-31af4edd23a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.339894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d3782-c4da-4c33-a4cf-31af4edd23a1 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.340785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d3782-c4da-4c33-a4cf-31af4edd23a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:08.341197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d3782-c4da-4c33-a4cf-31af4edd23a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:08.342686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d3782-c4da-4c33-a4cf-31af4edd23a1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:08.351947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 418/845] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:08.364912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c252ff-a012-4d2c-8f64-a4ea4b30c3fd None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.365189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c252ff-a012-4d2c-8f64-a4ea4b30c3fd None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.365452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c252ff-a012-4d2c-8f64-a4ea4b30c3fd None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.371255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 419/846] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:08.372706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5461c4-37e6-481b-a55d-2fe390cbcb99 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.372993 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5461c4-37e6-481b-a55d-2fe390cbcb99 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.373264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5461c4-37e6-481b-a55d-2fe390cbcb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.381154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 428/847] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 04:54:08.386669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.394162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-1e5461c4-37e6-481b-a55d-2fe390cbcb99 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:08.395578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1e5461c4-37e6-481b-a55d-2fe390cbcb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:08.471853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 420/848] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:08.504183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c684610-8169-4e30-bf56-02104affab9c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:08.542865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795f287-b2df-4ccd-8f61-6eb0bccdb689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:08.543415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f287-b2df-4ccd-8f61-6eb0bccdb689 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.543688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f287-b2df-4ccd-8f61-6eb0bccdb689 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.543975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f287-b2df-4ccd-8f61-6eb0bccdb689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.554707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795f287-b2df-4ccd-8f61-6eb0bccdb689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:08.556187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795f287-b2df-4ccd-8f61-6eb0bccdb689 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-4795f287-b2df-4ccd-8f61-6eb0bccdb689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:08.571699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:08.573474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:08.574667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:08.574667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:08.574667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:08.574667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 429/849] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:08.578672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5461c4-37e6-481b-a55d-2fe390cbcb99 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.604614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8321-7165-42a3-b884-5e67829bc604 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.605199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8321-7165-42a3-b884-5e67829bc604 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.605696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8321-7165-42a3-b884-5e67829bc604 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.607499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 430/850] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:08.613104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341b3ba-928b-46dc-8403-dc83755edd81 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.613592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341b3ba-928b-46dc-8403-dc83755edd81 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.614324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341b3ba-928b-46dc-8403-dc83755edd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.621338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:08.635169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7341b3ba-928b-46dc-8403-dc83755edd81 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:08.636764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7341b3ba-928b-46dc-8403-dc83755edd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:08.673164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:08.693963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5461c4-37e6-481b-a55d-2fe390cbcb99 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:08.735058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 431/851] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:08.745744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341b3ba-928b-46dc-8403-dc83755edd81 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.746100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:08.747000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.747495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.748123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.748974 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:08.749517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:08.750900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:08.763617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 421/852] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:08.768980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.865716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341b3ba-928b-46dc-8403-dc83755edd81 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:08.893103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04797d3-5a93-4b47-b890-0f08fa5cb8bc None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:08.903435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:08.908880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:08.909778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.910258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.911316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.922384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:08.928275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:08.929243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:54:08.930191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:08.935937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:08.935937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:08.935937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:08.935937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:08.936821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 432/853] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:54:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:08.939653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.946169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:08.948021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:08.961279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:08.962235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:08.963135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:08.965505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 422/854] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:08.971072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:08.983579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:09.056198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ad8df-c19c-4c08-95d4-8701e9e091bb None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.093447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.094059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.094335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.094602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.094861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec95dd-3275-40d7-b1b0-04d4311881ff None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.095272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:09.095572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.097069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.105652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 433/855] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:54:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:09.110708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.130405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.130936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.131211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.131482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.132197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:09.132503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.134025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.150803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 423/856] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:09.150803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.174638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:09.221371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4251d0-4dc4-4921-9b65-26429116f411 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.222610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:09.258418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.259043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.259317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.259585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.260004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf557a-696b-44e6-bfc8-32732ae02444 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.260184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.261547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:09.270283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:09.271220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:09.272145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 434/857] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:09.272960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.300362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.300982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.301819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.302202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.312461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.313896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:09.328782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:09.329772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:09.330683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:09.330683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:09.330683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:09.330683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 424/858] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:09.330683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.391261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8e4d3-302a-4fb5-ae2d-4089362083c2 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.408901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:09.427467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.432862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.432862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.432862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.432862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=3101f5b8db404c0893687ad8cc51bb4b) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:09.432862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.432862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.437913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 435/859] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/role_assignments?user.id=3101f5b8db404c0893687ad8cc51bb4b&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:09.439025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.440685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee417789-1db5-4161-8278-2a8ec6617ed8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.463190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:09.489460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.490261 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.490638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.491011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.491773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:09.492369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.494318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.500301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 425/860] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:09.506000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.572036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24d748-8936-4262-bc5f-e8851643e110 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.609686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.610543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.610969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.611388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.612204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:09.612675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.614795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.628366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 436/861] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:09.631061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164950d9-0ceb-4a7b-8e9f-c40e5e32a29a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.637369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.678408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.678925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.679210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.679485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.684217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:09.684836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.685927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.690092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:09.696053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 426/862] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:09.758988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85727573-b63d-4079-89d7-63401dd901cf None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.797886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.798533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.798815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.799084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.808321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.809813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:09.822723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:09.823934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:09.825090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 437/863] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:09.831138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:09.889876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:09.945813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c524098-58dd-4ad6-9324-2f34c3a2d89f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:09.983715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:09.984683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:09.985119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:09.985394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:09.986135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:09.986438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:09.987892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:10.008034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 427/864] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 25 04:54:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:10.013350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:10.120648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9c2c0-7c6b-4939-96bd-7338295a896a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:10.122338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:10.155115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff808c7-a810-440b-a47e-316b79001997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:10.155773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff808c7-a810-440b-a47e-316b79001997 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:10.156074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff808c7-a810-440b-a47e-316b79001997 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:10.156344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff808c7-a810-440b-a47e-316b79001997 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:10.227230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff808c7-a810-440b-a47e-316b79001997 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:10.228647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff808c7-a810-440b-a47e-316b79001997 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:10.330715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 438/865] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:54:10.337412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:10.406928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cc5f-56ee-409b-aa5c-cac39f742d7b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:10.407245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cc5f-56ee-409b-aa5c-cac39f742d7b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:10.407485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225cc5f-56ee-409b-aa5c-cac39f742d7b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:10.409418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 439/866] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:10.415644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db4b1-d42d-4b6b-a6a8-7807328d7e5d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:10.415864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db4b1-d42d-4b6b-a6a8-7807328d7e5d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:10.423131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db4b1-d42d-4b6b-a6a8-7807328d7e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:10.424430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:10.439593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-125db4b1-d42d-4b6b-a6a8-7807328d7e5d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:10.441281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-125db4b1-d42d-4b6b-a6a8-7807328d7e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:10.454287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0ec8e-ce7c-4c25-a78e-ccd140110b33 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:10.456808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:10.491724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:10.492602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:10.493030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:10.493467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:10.503935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:10.506106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:10.523320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:10.524644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:10.525758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:10.525758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:10.525758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:10.527473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 428/867] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:10.528286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 440/868] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:10.532508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:10.639366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839f605-c9d6-44c3-baf1-02f548e794ed None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:10.680466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:10.681751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:10.682184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:10.682604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:10.683435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:10.683901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:10.685451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:10.699179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 429/869] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:10.705993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125db4b1-d42d-4b6b-a6a8-7807328d7e5d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:10.812401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125db4b1-d42d-4b6b-a6a8-7807328d7e5d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:10.813843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:10.834175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:10.848973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:10.852554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:10.853193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:10.853526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:10.853811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:10.860826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:10.862349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:10.874560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:10.875496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:10.876775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 441/870] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:10.883074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:10.954339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440a4d2-b4a8-4efd-a116-30a4088c31e0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:10.993851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e6b47-f305-44e7-9634-8f9999163233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:10.994835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e6b47-f305-44e7-9634-8f9999163233 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:10.995321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e6b47-f305-44e7-9634-8f9999163233 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:10.995822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e6b47-f305-44e7-9634-8f9999163233 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:10.996703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e6b47-f305-44e7-9634-8f9999163233 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:10.998345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e6b47-f305-44e7-9634-8f9999163233 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:11.016124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e82f6-c9fc-4a0e-b115-54649dcdaa6d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:11.051751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:11.052480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:11.052807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:11.053078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:11.053781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:11.054068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:11.055547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:11.082601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 442/872] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:11.082790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 430/872] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:54:10 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:11.082875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:11.144562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:11.203782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a00a0-d025-419c-a2bb-726e50946a28 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:11.257590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393af21-fe99-4c99-a688-d6d1f12634a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:11.258453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393af21-fe99-4c99-a688-d6d1f12634a6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:11.258737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393af21-fe99-4c99-a688-d6d1f12634a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:11.259005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393af21-fe99-4c99-a688-d6d1f12634a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:11.259728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393af21-fe99-4c99-a688-d6d1f12634a6 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=6e73a2cbe56e4cc7b8d52e53300bd809) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:11.260133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393af21-fe99-4c99-a688-d6d1f12634a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:11.261590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393af21-fe99-4c99-a688-d6d1f12634a6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:11.269401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 443/873] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:11 2022] GET /identity/v3/role_assignments?user.id=6e73a2cbe56e4cc7b8d52e53300bd809&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:11.497019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183705a-1f5d-4643-bfeb-ab669b19f950 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:11.497375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183705a-1f5d-4643-bfeb-ab669b19f950 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:11.497569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183705a-1f5d-4643-bfeb-ab669b19f950 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:11.500390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 431/874] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:11.507849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9c39-dd25-445e-a1d0-6e68019a83a8 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:11.509032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9c39-dd25-445e-a1d0-6e68019a83a8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:11.509366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb9c39-dd25-445e-a1d0-6e68019a83a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:11.533452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-4cfb9c39-dd25-445e-a1d0-6e68019a83a8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:11.534662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4cfb9c39-dd25-445e-a1d0-6e68019a83a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:11.609757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 444/875] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:11.818506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1111f6-bbc9-4f1c-8930-470e64dd7520 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:11.819028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1111f6-bbc9-4f1c-8930-470e64dd7520 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:11.819028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1111f6-bbc9-4f1c-8930-470e64dd7520 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:11.820629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 432/876] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:11.825746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979b05d-9d4b-4e0c-9efc-ab59628cf661 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:11.826126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979b05d-9d4b-4e0c-9efc-ab59628cf661 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:11.826356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979b05d-9d4b-4e0c-9efc-ab59628cf661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:11.845289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d979b05d-9d4b-4e0c-9efc-ab59628cf661 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:11.846478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d979b05d-9d4b-4e0c-9efc-ab59628cf661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:11.881691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1111f6-bbc9-4f1c-8930-470e64dd7520 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:11.889252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:11.923076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 445/877] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:11.968802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:11.994086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1111f6-bbc9-4f1c-8930-470e64dd7520 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:12.028779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:12.029784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:12.030062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:12.030331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:12.030981 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:12.032408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:12.042363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:12.046230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:12.047615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 433/878] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:12.049387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979b05d-9d4b-4e0c-9efc-ab59628cf661 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:12.151590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979b05d-9d4b-4e0c-9efc-ab59628cf661 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:12.190326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:12.190928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:12.191203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:12.191471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:12.192676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:12.192974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:12.194345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:12.198674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:12.199483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 446/879] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:12.205606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:12.251861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:12.323132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89b48-15b7-469a-ba1a-cc763d6c7b2c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:12.328434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81157836-f05f-47bd-bee6-61b708908376 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:12.361723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7734dc-a39b-4e10-a9cc-8bc562208358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:12.362332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7734dc-a39b-4e10-a9cc-8bc562208358 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:12.362610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7734dc-a39b-4e10-a9cc-8bc562208358 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:12.362880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7734dc-a39b-4e10-a9cc-8bc562208358 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:12.363571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7734dc-a39b-4e10-a9cc-8bc562208358 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:12.363880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7734dc-a39b-4e10-a9cc-8bc562208358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:12.364794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3819992-6ec3-4740-95e3-1e059e1b962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:12.365297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7734dc-a39b-4e10-a9cc-8bc562208358 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:12.365405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3819992-6ec3-4740-95e3-1e059e1b962c None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:12.365659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3819992-6ec3-4740-95e3-1e059e1b962c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:12.365929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3819992-6ec3-4740-95e3-1e059e1b962c None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:12.366673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3819992-6ec3-4740-95e3-1e059e1b962c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:12.368214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3819992-6ec3-4740-95e3-1e059e1b962c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:12.372000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 447/880] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:12.482620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:12.488966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 434/881] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:54:12 2022] POST /identity/v3/services => generated 269 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:13.099830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3989f-26c1-428b-b3e2-cb01e4f2621b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.100554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3989f-26c1-428b-b3e2-cb01e4f2621b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.100554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3989f-26c1-428b-b3e2-cb01e4f2621b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.102041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 448/882] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:13.107342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddc9d-b457-4063-8ace-e4eded788742 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.107793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddc9d-b457-4063-8ace-e4eded788742 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.107966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddc9d-b457-4063-8ace-e4eded788742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.126017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3f4ddc9d-b457-4063-8ace-e4eded788742 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:13.127222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3f4ddc9d-b457-4063-8ace-e4eded788742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:13.201454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 435/883] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:13.357973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfadfc-a852-4ffc-bb48-886fbbe381c7 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.358576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfadfc-a852-4ffc-bb48-886fbbe381c7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.359086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfadfc-a852-4ffc-bb48-886fbbe381c7 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.360920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 449/884] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:13.372284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f9e3a-8180-42dd-9168-f114775b4e13 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.372861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f9e3a-8180-42dd-9168-f114775b4e13 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.373346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f9e3a-8180-42dd-9168-f114775b4e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.392421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-270f9e3a-8180-42dd-9168-f114775b4e13 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:13.393922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-270f9e3a-8180-42dd-9168-f114775b4e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:13.466317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 436/885] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:13.476372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfadfc-a852-4ffc-bb48-886fbbe381c7 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:13.581967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:13.585130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfadfc-a852-4ffc-bb48-886fbbe381c7 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:13.621183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:13.622150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.622625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.623089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.623874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:13.625449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:13.635077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:13.636364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:13.637206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:13.639776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 450/886] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:13.649397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f9e3a-8180-42dd-9168-f114775b4e13 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:13.707671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:13.754895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f9e3a-8180-42dd-9168-f114775b4e13 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:13.773078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:13.795516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:13.796161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.796438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.796710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.797341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:13.797639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:13.799131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:13.805189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 437/887] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:13.810566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:13.908939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25f90c-5e01-493b-8c84-54a7991ce66f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:13.916432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f20d-59a8-4889-a4ef-1be1526b79e0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:13.938557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:13.954723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:13.955337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.955616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.955889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.956557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:13.956862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:13.957413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:13.958266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:13.958469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:13.958959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:13.959425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:13.969870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 438/888] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:13.971505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:13.972183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:13.980206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:13.981155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:13.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:13.988004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 451/889] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 25 04:54:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:13.991005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:14.027528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:14.106058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfa57-97b0-4d80-b1ca-9f2bf80dd983 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.117291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277ce89-e063-4fd8-8855-cea6b34cd7fa None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.143767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.144423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.144743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.145019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.145690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:14.145992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.147368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.160132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 452/890] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 25 04:54:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:14.162097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:14.163531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.164385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.165050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.165532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.167309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] RBAC: Adding query filter params (interface=public, service_id=b355966e942a46ac9d04c742cc1b2728, region_id=RegionOne) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:14.167826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.169448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.177287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 439/891] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:54:13 2022] GET /identity/v3/endpoints?service_id=b355966e942a46ac9d04c742cc1b2728&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:14.182923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:14.252704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:14.266538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:14.282694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc44582-2802-42c4-a38a-fc484c4cb2fa None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.318832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cca88-29ff-4e10-9eae-6dfcec6cb5c3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.320343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e1021-4d1f-44b8-8ae9-054bf438837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.322196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1021-4d1f-44b8-8ae9-054bf438837b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.322996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1021-4d1f-44b8-8ae9-054bf438837b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.323271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e1021-4d1f-44b8-8ae9-054bf438837b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.336041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e1021-4d1f-44b8-8ae9-054bf438837b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.337795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e1021-4d1f-44b8-8ae9-054bf438837b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.353400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ecd59-8f21-4a71-85dc-6a0091b5c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.354002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ecd59-8f21-4a71-85dc-6a0091b5c5af None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.354276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ecd59-8f21-4a71-85dc-6a0091b5c5af None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.354541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ecd59-8f21-4a71-85dc-6a0091b5c5af None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.355143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ecd59-8f21-4a71-85dc-6a0091b5c5af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-f64e1021-4d1f-44b8-8ae9-054bf438837b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:14.356121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:14.357012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:14.357905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:14.357905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:14.357905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:14.358074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ecd59-8f21-4a71-85dc-6a0091b5c5af None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.360275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 453/892] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:14.361812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869171a1-9b89-4709-bb88-6c9987f5c42d None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.362282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869171a1-9b89-4709-bb88-6c9987f5c42d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.362552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869171a1-9b89-4709-bb88-6c9987f5c42d None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.364709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 454/893] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:14.366765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 440/894] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:14 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 04:54:14.372028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869171a1-9b89-4709-bb88-6c9987f5c42d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:14.372209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55974c-a92f-42ff-96f0-271a156da50a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.372209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55974c-a92f-42ff-96f0-271a156da50a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.372209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55974c-a92f-42ff-96f0-271a156da50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.395036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cc55974c-a92f-42ff-96f0-271a156da50a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:14.397031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cc55974c-a92f-42ff-96f0-271a156da50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:14.505234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 441/895] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:14.520290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869171a1-9b89-4709-bb88-6c9987f5c42d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.529827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8c145-8147-4c1b-a647-607e26d174e9 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.530100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8c145-8147-4c1b-a647-607e26d174e9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.530371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8c145-8147-4c1b-a647-607e26d174e9 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.531856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 442/896] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:14.538145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102d3e-23f0-45f6-b62e-1eaff1f77046 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.538683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102d3e-23f0-45f6-b62e-1eaff1f77046 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.539163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102d3e-23f0-45f6-b62e-1eaff1f77046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.565876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a3102d3e-23f0-45f6-b62e-1eaff1f77046 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:14.568043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a3102d3e-23f0-45f6-b62e-1eaff1f77046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:14.574899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.575878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.576270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.576575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.577273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:14.577584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.579163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.592137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:14.603981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 455/897] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:14.607400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:14.623922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:14.663465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 443/898] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:14.731047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c9a4c-0747-4cec-829a-9e150701de08 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.767013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.767545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.767821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.768125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.776176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.777639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:14.789167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:14.790194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:14.791240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:14.795078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 456/899] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:54:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:14.796595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3102d3e-23f0-45f6-b62e-1eaff1f77046 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:14.797892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:14.875951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:14.906354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3102d3e-23f0-45f6-b62e-1eaff1f77046 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.921454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f77c5-7b7f-402a-ba5c-2abf390ec208 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:14.952480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718374af-fc45-4171-8c87-325890867186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.953496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718374af-fc45-4171-8c87-325890867186 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.953777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718374af-fc45-4171-8c87-325890867186 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.954305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718374af-fc45-4171-8c87-325890867186 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.955153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718374af-fc45-4171-8c87-325890867186 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:14.955460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718374af-fc45-4171-8c87-325890867186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.957708 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718374af-fc45-4171-8c87-325890867186 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.958537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:14.959203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:14.959485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:14.959756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:14.960427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:14.961775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:14.978075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 444/900] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 25 04:54:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:14.978972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718374af-fc45-4171-8c87-325890867186 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.011723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:15.029950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 457/901] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:54:14 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:15.030705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.109834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718374af-fc45-4171-8c87-325890867186 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.157731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177e3a6-908f-4ee5-8877-5e32dabb109e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.162072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.163378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.163891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.164393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.165213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.167380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.173545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:15.179986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:15.180986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:15.181907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:15.184306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 445/902] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Aug 25 04:54:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:15.191178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.196749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.197358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.197633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.197904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.296279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.298961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.309473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:15.317664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628ae2b-476a-413c-90df-21e790448124 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.353652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.354706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.355209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.355980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.356742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:15.357105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.358582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.368484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 446/903] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:15.370090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.435639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 458/904] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:54:15.442874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.456598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:15.505713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bc290-5690-46f4-889f-42a6f619cc56 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.550367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.551552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3fa3-95fe-4d68-bfb5-e66809d8726c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.551858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.552282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.552651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.553553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:15.554761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.556266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.564070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 447/905] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:15.568650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.594478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.595198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.595545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.595928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.600311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:15.609021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.612202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:15.626762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:15.628277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:15.629256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:15.629256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:15.629256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:15.636663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 459/906] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:15.638194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.688673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad30d00-c946-4726-ab54-b5c9cdc39ebc None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.715101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:15.735624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.736297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.736572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.736841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.737713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] RBAC: Adding query filter params (interface=public, service_id=fc88bffa286b4d8ea5bd71f2a2b37606, region_id=RegionOne) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:15.738019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.740411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.748062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 448/907] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/endpoints?service_id=fc88bffa286b4d8ea5bd71f2a2b37606&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:15.753645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.762754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e1762-f814-4505-925a-72d5644513d9 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.808118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.809057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.809960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.810442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.811550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:15.812229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.814428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.835146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 460/908] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:15.840519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:15.846875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:15.867766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a62fde-5aa0-4ea6-a101-22e231e99784 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.914921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:15.915595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:15.915880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:15.916176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:15.916791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:15.918224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:15.931937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 449/909] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 04:54:15.963414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73f40-302a-4951-ae44-0c3d629e103b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:15.994414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:16.004578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:16.005410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:16.012486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:16.012486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:16.014017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:16.015647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:16.028933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:16.030097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:16.031286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:16.033806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 461/910] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:16.040294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:16.151531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef302-5bd4-4630-9bb0-441b58ca471d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:16.188617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb38b49-7da9-4c43-95ab-b5de4df96f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:16.189382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38b49-7da9-4c43-95ab-b5de4df96f4a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:16.189592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38b49-7da9-4c43-95ab-b5de4df96f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:16.189908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38b49-7da9-4c43-95ab-b5de4df96f4a None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:16.190706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38b49-7da9-4c43-95ab-b5de4df96f4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:16.191073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38b49-7da9-4c43-95ab-b5de4df96f4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:16.193126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb38b49-7da9-4c43-95ab-b5de4df96f4a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:16.206090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 450/911] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:16.212263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:16.323296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7369-4bdc-4bfb-9984-cd532197bd57 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:16.348106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873a07-8cb4-4bea-abcf-45f91ef14498 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:16.348410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873a07-8cb4-4bea-abcf-45f91ef14498 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:16.348668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873a07-8cb4-4bea-abcf-45f91ef14498 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:16.350503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 451/912] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:16.355745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661248f-39fb-4da8-b7bc-a5f4c3853062 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:16.356067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661248f-39fb-4da8-b7bc-a5f4c3853062 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:16.356349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661248f-39fb-4da8-b7bc-a5f4c3853062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:16.361940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:16.362940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:16.364122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:16.364398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:16.365133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] RBAC: Adding query filter params (role.id=bf4489619afb44eda29600a33a606567, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=6e73a2cbe56e4cc7b8d52e53300bd809) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:16.365441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:16.366864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:16.372911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 462/913] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:16 2022] GET /identity/v3/role_assignments?user.id=6e73a2cbe56e4cc7b8d52e53300bd809&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=bf4489619afb44eda29600a33a606567 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:16.381441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4661248f-39fb-4da8-b7bc-a5f4c3853062 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:16.383052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4661248f-39fb-4da8-b7bc-a5f4c3853062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:16.386762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:16.462577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 452/914] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:16.767594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:16.820490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:16.872040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db482f-1803-48f0-9201-1f4ad1c8ded6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:16.907819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6556e9-b646-437f-b61e-06a9d5f37d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:16.908482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6556e9-b646-437f-b61e-06a9d5f37d85 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:16.908759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6556e9-b646-437f-b61e-06a9d5f37d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:16.909033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6556e9-b646-437f-b61e-06a9d5f37d85 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:16.909619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6556e9-b646-437f-b61e-06a9d5f37d85 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:16.911617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6556e9-b646-437f-b61e-06a9d5f37d85 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-bf6556e9-b646-437f-b61e-06a9d5f37d85 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:16.920662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:16.921655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:16.923118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 463/915] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:16.928280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661248f-39fb-4da8-b7bc-a5f4c3853062 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:17.053925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661248f-39fb-4da8-b7bc-a5f4c3853062 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:17.057392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb59de-4457-4052-9cba-5542a28ecf3f None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.057682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb59de-4457-4052-9cba-5542a28ecf3f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.057957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb59de-4457-4052-9cba-5542a28ecf3f None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.059454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 464/916] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:17.065442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076b06-9857-4c16-998f-6d852d81ca6e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.065724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076b06-9857-4c16-998f-6d852d81ca6e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.066000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076b06-9857-4c16-998f-6d852d81ca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.090193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-9d076b06-9857-4c16-998f-6d852d81ca6e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:17.091929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9d076b06-9857-4c16-998f-6d852d81ca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:17.098333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:17.098954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.099232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.099503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.100420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:17.100721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:17.102170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:17.107609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 453/917] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:17.115248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:17.122603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:17.193929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 465/918] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:17.241728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202d57f-19d0-465e-bb0b-e346f4b157de None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:17.277398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:17.278004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.278284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.278554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.279181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:17.279482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:17.280878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:17.286177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 454/919] 10.222.0.45 () {56 vars in 1114 bytes} [Thu Aug 25 04:54:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:17.291839 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d076b06-9857-4c16-998f-6d852d81ca6e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:17.339669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:17.400188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d076b06-9857-4c16-998f-6d852d81ca6e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:17.435635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:17.436340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.436959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.437231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.437908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:17.439280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:17.468379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:17.510080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 466/920] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:17.556412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:17.598519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508a8ff-e5cd-470c-8c8a-469c2839572a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:17.645586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:17.646626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.647162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.647661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.648613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:17.650000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:17.660676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:17.661748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:17.662597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 455/921] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:17.668176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:17.786606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:17.790829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa695a-ac0b-4eb4-b126-ab4fe71eb67c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:17.827560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:17.828581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.829070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.829548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.830408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:17.830917 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:17.833125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:17.838643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 467/922] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:17.844728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:17.951877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373cbd0-bde1-411b-b482-3daf459126b3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:17.988495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60340c-bf75-4d38-ba39-15de0885e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:17.989429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:17.989976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60340c-bf75-4d38-ba39-15de0885e428 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:17.990437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60340c-bf75-4d38-ba39-15de0885e428 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:17.991120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60340c-bf75-4d38-ba39-15de0885e428 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:17.991988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60340c-bf75-4d38-ba39-15de0885e428 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:17.992492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60340c-bf75-4d38-ba39-15de0885e428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:17.994074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60340c-bf75-4d38-ba39-15de0885e428 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:17.999764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 456/923] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:18.006926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:18.046176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ae7c4-181c-4813-bd03-ce004ce244db None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.046524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ae7c4-181c-4813-bd03-ce004ce244db None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.046721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ae7c4-181c-4813-bd03-ce004ce244db None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.048357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 457/924] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:18.055566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf4a5-56b6-494c-9a74-22a1a78f32de None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.055843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf4a5-56b6-494c-9a74-22a1a78f32de None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.056146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccf4a5-56b6-494c-9a74-22a1a78f32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.078309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5cccf4a5-56b6-494c-9a74-22a1a78f32de None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:18.079767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5cccf4a5-56b6-494c-9a74-22a1a78f32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:18.123359 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518d8c3-cb8a-43db-8679-394e14de68c8 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:18.162143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f47bc6-9499-4b7f-9acd-69bceba9c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:18.162756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f47bc6-9499-4b7f-9acd-69bceba9c015 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.163029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f47bc6-9499-4b7f-9acd-69bceba9c015 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.163298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f47bc6-9499-4b7f-9acd-69bceba9c015 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.164215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f47bc6-9499-4b7f-9acd-69bceba9c015 None admin] RBAC: Adding query filter params (interface=public, service_id=f8d781950f9647d7a0e7355f033aee2e, region_id=RegionOne) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:18.164522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f47bc6-9499-4b7f-9acd-69bceba9c015 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:18.165890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f47bc6-9499-4b7f-9acd-69bceba9c015 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:18.176740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 458/926] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:18.179000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 468/926] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:54:18 2022] GET /identity/v3/endpoints?service_id=f8d781950f9647d7a0e7355f033aee2e&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:18.180342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccf4a5-56b6-494c-9a74-22a1a78f32de None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:18.288107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccf4a5-56b6-494c-9a74-22a1a78f32de None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:18.311397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:18.324026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cbdd4-e519-4b6d-88be-7594a8b0da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:18.324643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbdd4-e519-4b6d-88be-7594a8b0da3e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.324925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbdd4-e519-4b6d-88be-7594a8b0da3e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.330064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbdd4-e519-4b6d-88be-7594a8b0da3e None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.330064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cbdd4-e519-4b6d-88be-7594a8b0da3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:18.330064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35cbdd4-e519-4b6d-88be-7594a8b0da3e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:18.334512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 459/927] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:18 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 04:54:18.399375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f89c7-b937-4a76-86e3-7fcaf1801bcd None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.399947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f89c7-b937-4a76-86e3-7fcaf1801bcd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.399947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f89c7-b937-4a76-86e3-7fcaf1801bcd None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.401336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 469/928] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:18.406971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e06305-73d5-4640-9537-3065bf84bfe1 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.407252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e06305-73d5-4640-9537-3065bf84bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.407535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e06305-73d5-4640-9537-3065bf84bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.431184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-28e06305-73d5-4640-9537-3065bf84bfe1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:18.432862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-28e06305-73d5-4640-9537-3065bf84bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:18.452549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f89c7-b937-4a76-86e3-7fcaf1801bcd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:18.489175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:18.508154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 460/929] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:18.582118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f89c7-b937-4a76-86e3-7fcaf1801bcd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:18.618348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:18.618982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.619304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.619585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.620253 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:18.621629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:18.630754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:18.631708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:18.632842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 470/930] 10.222.0.45 () {56 vars in 1132 bytes} [Thu Aug 25 04:54:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:18.641010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e06305-73d5-4640-9537-3065bf84bfe1 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:18.757893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e06305-73d5-4640-9537-3065bf84bfe1 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:18.780815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:18.794783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:18.795399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.795673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.795963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.796592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:18.796949 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:18.798385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:18.802522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:18.804419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 461/931] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:18.810012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:18.914096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:18.923589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fee2b8-1228-43ee-a0d6-6be925129f59 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:18.929932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb345c-c1ed-4936-bab9-833fb906ee47 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:18.968343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:18.968946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.969218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.969491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.974259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:18.975379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:18.975875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:18.976369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:18.977206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:18.977877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:18.979629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:18.982594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:18.990015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:18.991000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 471/933] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 25 04:54:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:18.991849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:18.992665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 462/933] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:18.996902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:19.046864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:19.102725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b58f00-5570-48ef-99c5-8a0025bded58 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:19.109538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bfba2-9b9b-41dd-9a03-3f165b6272cb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:19.140615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:19.141224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.141647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.141920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.142574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:19.144117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:19.157365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:19.158328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.158866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.159332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.160806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:19.161325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:19.162979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:19.172376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 463/934] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 25 04:54:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:19.178948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:19.243944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 472/935] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:19.304195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0feb-f85f-4749-91c0-06e5c9a23a49 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:19.312804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:19.351012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:19.351697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.352073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.352348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.365264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:19.366806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:19.382486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:19.383507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:19.384460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:19.384460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:19.384460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:19.388059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 464/936] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:19.389976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:19.403294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:19.509827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d035e2b-0799-4507-a7a5-c4b0b2d06da1 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:19.545156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a3b0f-7f99-430e-949a-7db220572389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:19.546039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a3b0f-7f99-430e-949a-7db220572389 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.546460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a3b0f-7f99-430e-949a-7db220572389 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.546900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a3b0f-7f99-430e-949a-7db220572389 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.547727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a3b0f-7f99-430e-949a-7db220572389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:19.548212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a3b0f-7f99-430e-949a-7db220572389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:19.549853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a3b0f-7f99-430e-949a-7db220572389 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:19.564617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 473/937] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:19.570740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:19.589735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b76525-ca45-46b2-832e-c9f2dfbfbe80 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.590061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b76525-ca45-46b2-832e-c9f2dfbfbe80 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.590283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b76525-ca45-46b2-832e-c9f2dfbfbe80 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.591841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 474/938] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:19.596855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfced88-8010-4b20-b436-792aad1799bb None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.597131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfced88-8010-4b20-b436-792aad1799bb None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.597398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfced88-8010-4b20-b436-792aad1799bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.617346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-6cfced88-8010-4b20-b436-792aad1799bb None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:19.618551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6cfced88-8010-4b20-b436-792aad1799bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:19.688634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:19.691994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fef96-91e9-4cb7-a314-ca7de166c333 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:19.699930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 475/939] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:19.729108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:19.729770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.730042 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.730385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.738231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:19.739865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:19.751251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:19.752240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:19.753230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:19.757801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 465/940] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:54:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:19.759250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfced88-8010-4b20-b436-792aad1799bb None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:19.862208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfced88-8010-4b20-b436-792aad1799bb None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:19.897958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:19.898571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:19.898848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:19.899170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:19.899926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:19.900232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:19.901663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:19.925233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 476/941] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 25 04:54:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:19.927086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:19.944500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:19.982965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:20.038198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b7843-80a7-4297-be07-9652f87ea85e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:20.048065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:20.078383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:20.079037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.079294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.079559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.090275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:20.091614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:20.101046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a0b1-b8a5-4bec-a2d8-6e22c40de2bf None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:20.106768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:20.107929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:20.109146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:20.109146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:20.109146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:20.112749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 466/942] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:20.114222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:20.144223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:20.145756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.146297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.146739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.147527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:20.149271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:20.152415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING keystone.server.flask.common [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 25 04:54:20.184762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:20.200610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.sql.core [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 04:54:20.200610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 04:54:20.200610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [parameters: {'id': '3b028801b6dd456897ad904bf1ff8997', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 04:54:20.200610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81750) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b028801b6dd456897ad904bf1ff8997.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b028801b6dd456897ad904bf1ff8997. Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application conn.query(q) Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 04:54:20.219224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result.read() Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 25 04:54:20.220302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application next(self.gen) Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application yield resource Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application next(self.gen) Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise self.value Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application session.commit() Aug 25 04:54:20.221531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.session.flush() Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application compat.raise_( Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 04:54:20.222826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 04:54:20.224017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application conn.query(q) Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result.read() Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 04:54:20.225083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [parameters: {'id': '3b028801b6dd456897ad904bf1ff8997', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:20.225969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:20.228801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3b028801b6dd456897ad904bf1ff8997. Aug 25 04:54:20.230955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.233258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895ed5c-4119-4a60-8f20-5c8ec4c53a27 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:20.236978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 477/943] 10.222.0.45 () {60 vars in 1140 bytes} [Thu Aug 25 04:54:19 2022] POST /identity/v3/projects => generated 262 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:20.247161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:20.282304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:20.283303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.283765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.284425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.285472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:20.286015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:20.288466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:20.303541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 467/944] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:20.309771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:20.379391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc88206-29c4-431c-b065-31faac3a6314 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:20.395046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:20.422980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:20.423734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.424119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.424459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.432939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:20.434728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:20.447585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:20.448802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:20.449911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:20.456227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 478/945] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:20.459008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:20.463077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348cec8-a247-49f5-be46-b0cc156b241d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:20.494672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:20.507085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8c843-37da-41ab-a81f-72bec561e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:20.507749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c843-37da-41ab-a81f-72bec561e117 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.508079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c843-37da-41ab-a81f-72bec561e117 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.508389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c843-37da-41ab-a81f-72bec561e117 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.515812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8c843-37da-41ab-a81f-72bec561e117 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:20.517386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8c843-37da-41ab-a81f-72bec561e117 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-84d8c843-37da-41ab-a81f-72bec561e117 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:20.530356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:20.531647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 468/946] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd493a-0d65-4d89-801e-c01e8f57b5d1 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.533205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd493a-0d65-4d89-801e-c01e8f57b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.533955 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd493a-0d65-4d89-801e-c01e8f57b5d1 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.534757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 469/947] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:20.540977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2af0-8511-4436-a984-746923c026bf None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.541254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2af0-8511-4436-a984-746923c026bf None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.541526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d2af0-8511-4436-a984-746923c026bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.565233 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-534d2af0-8511-4436-a984-746923c026bf None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:20.567197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-534d2af0-8511-4436-a984-746923c026bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:20.596134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795b46-9e67-453c-afa6-4e1212a66c0f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:20.637845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:20.638735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.639009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.639280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.639979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:20.640285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:20.641861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:20.658861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 470/948] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:20.660665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2af0-8511-4436-a984-746923c026bf None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:20.675564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 479/949] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:20.827745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d2af0-8511-4436-a984-746923c026bf None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:20.853523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:20.876562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:20.877187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:20.877465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:20.877744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:20.878445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:20.878836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:20.880688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:20.896707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 471/950] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:20.903862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:20.946948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:21.001826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:21.042052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd210d-7fd2-4c88-a9fc-d3665cca48dc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:21.087242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:21.088602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:21.089154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:21.089709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/6e73a2cbe56e4cc7b8d52e53300bd809/roles/bf4489619afb44eda29600a33a606567` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:21.093698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=6e73a2cbe56e4cc7b8d52e53300bd809, role_id=bf4489619afb44eda29600a33a606567)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:21.095787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:21.124750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbef4-b658-4060-abd5-6bdb39b11acb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:21.161925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:21.162476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:21.162750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:21.163021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:21.163600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:21.165034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:21.174926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:21.176689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:21.177574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:21.181773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 472/951] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:21.183001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:21.189484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 480/952] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:54:20 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/6e73a2cbe56e4cc7b8d52e53300bd809/roles/bf4489619afb44eda29600a33a606567 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:54:21.242342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:21.312966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ea82-16c1-4b56-97f6-4e4f4248b703 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:21.354485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10415723-020d-4149-a4bc-f6a0425ec82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:21.355111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10415723-020d-4149-a4bc-f6a0425ec82c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:21.355389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10415723-020d-4149-a4bc-f6a0425ec82c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:21.355719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10415723-020d-4149-a4bc-f6a0425ec82c None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:21.356401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10415723-020d-4149-a4bc-f6a0425ec82c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:21.356818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10415723-020d-4149-a4bc-f6a0425ec82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:21.358212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10415723-020d-4149-a4bc-f6a0425ec82c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:21.364386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 473/953] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:21.370160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:21.454871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c7f4-f151-48f6-abe1-8c634b6467a9 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:21.455062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c7f4-f151-48f6-abe1-8c634b6467a9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:21.455332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2c7f4-f151-48f6-abe1-8c634b6467a9 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:21.457025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 474/954] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:21.462496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eb816-526f-45de-afcb-ed03f58af714 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:21.462781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eb816-526f-45de-afcb-ed03f58af714 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:21.463061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eb816-526f-45de-afcb-ed03f58af714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:21.475274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:21.482769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-755eb816-526f-45de-afcb-ed03f58af714 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:21.484004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-755eb816-526f-45de-afcb-ed03f58af714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:21.484115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf00dd-3521-4846-a181-c5d03b813d96 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:21.529298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:21.530802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:21.531079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:21.531349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:21.532037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:21.532339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:21.533704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:21.540409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 481/955] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:21.545635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:21.580021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 475/956] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:21.649221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079015dc-7c6f-4edf-9724-1e48e203c072 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:21.688523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:21.689129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:21.689403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:21.689668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:21.690332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:21.692535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:21.806586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 482/957] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:21.861763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eb816-526f-45de-afcb-ed03f58af714 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:21.901828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:21.978389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eb816-526f-45de-afcb-ed03f58af714 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:22.019611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:22.020269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:22.020547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:22.020817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:22.021398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:22.022766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:22.031373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:22.032425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:22.033868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 476/958] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:22.039097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:22.055288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:22.144823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfdf00-be70-4dbc-b4d0-eb030ce8ce22 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:22.180213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29853549-407d-41d2-85ec-5fe66e13292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:22.180836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853549-407d-41d2-85ec-5fe66e13292c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:22.181113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853549-407d-41d2-85ec-5fe66e13292c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:22.181387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853549-407d-41d2-85ec-5fe66e13292c None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:22.182019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29853549-407d-41d2-85ec-5fe66e13292c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:22.182323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29853549-407d-41d2-85ec-5fe66e13292c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:22.183711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29853549-407d-41d2-85ec-5fe66e13292c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:22.189030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 483/959] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:22.195188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:22.296654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:22.304402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a2e2-43c7-43da-bb72-d300ea722336 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:22.341526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351561bf-94e0-4218-a74c-dbeada7643f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:22.342270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351561bf-94e0-4218-a74c-dbeada7643f2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:22.342613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351561bf-94e0-4218-a74c-dbeada7643f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:22.343267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351561bf-94e0-4218-a74c-dbeada7643f2 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:22.344170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351561bf-94e0-4218-a74c-dbeada7643f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:22.344845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351561bf-94e0-4218-a74c-dbeada7643f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:22.346586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351561bf-94e0-4218-a74c-dbeada7643f2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:22.352532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 477/960] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:22.810847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3451-98e0-45ab-af6e-0ee81cc72715 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:22.811369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3451-98e0-45ab-af6e-0ee81cc72715 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:22.811369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c3451-98e0-45ab-af6e-0ee81cc72715 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:22.813005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 484/961] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:22.818772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edafb08-8754-4bf4-9a4a-bf77fb908920 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:22.819055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edafb08-8754-4bf4-9a4a-bf77fb908920 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:22.819329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edafb08-8754-4bf4-9a4a-bf77fb908920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:22.837637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5edafb08-8754-4bf4-9a4a-bf77fb908920 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:22.838818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5edafb08-8754-4bf4-9a4a-bf77fb908920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:22.909132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 478/962] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:23.158682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55f109-849b-4f71-8b23-3ffeb5a02dbd None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.159062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55f109-849b-4f71-8b23-3ffeb5a02dbd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.159270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55f109-849b-4f71-8b23-3ffeb5a02dbd None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.161154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 485/963] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:23.166301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a9c5b-1003-4c68-ac06-66d1df54d629 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.166595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a9c5b-1003-4c68-ac06-66d1df54d629 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.166872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a9c5b-1003-4c68-ac06-66d1df54d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.184810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55f109-849b-4f71-8b23-3ffeb5a02dbd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:23.185872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-569a9c5b-1003-4c68-ac06-66d1df54d629 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:23.187214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-569a9c5b-1003-4c68-ac06-66d1df54d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:23.260160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 479/964] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:23.264338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:23.293182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55f109-849b-4f71-8b23-3ffeb5a02dbd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:23.329192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:23.329806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.330088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.330372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.331011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:23.332621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:23.383061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.sql.core [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 04:54:23.383061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 04:54:23.383061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [parameters: {'user_id': '0111c277b24148449efecc73bc5dd577', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 04:54:23.383061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81750) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application conn.query(q) Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result.read() Aug 25 04:54:23.389572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 04:54:23.390494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application next(self.gen) Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application yield resource Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application next(self.gen) Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise self.value Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application session.commit() Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 04:54:23.392168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.session.flush() Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application compat.raise_( Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 04:54:23.393101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 04:54:23.394042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application conn.query(q) Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application result.read() Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 04:54:23.395156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [parameters: {'user_id': '0111c277b24148449efecc73bc5dd577', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:23.401266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 25 04:54:23.403196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 25 04:54:23.405375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 25 04:54:23.405375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 25 04:54:23.405375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 04:54:23.405375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 04:54:23.405375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 04:54:23.405375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:23.405375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 486/965] 10.222.0.45 () {60 vars in 1131 bytes} [Thu Aug 25 04:54:23 2022] POST /identity/v3/users => generated 160 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:23.412321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a9c5b-1003-4c68-ac06-66d1df54d629 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:23.426374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:23.522477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a9c5b-1003-4c68-ac06-66d1df54d629 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:23.530628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:23.559703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:23.560640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.560924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.561184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.571715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:23.573268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:23.588440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:23.589645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 04:54:23.590844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:23.593212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 480/966] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:54:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:23.598702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:23.656717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3678a-81d7-4ec9-b4a7-2381b0ff99f5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:23.684130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:23.700969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:23.701879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.702229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.702894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.711810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:23.717000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98ff0b-bf4d-49e5-bde6-7444fbad81ee None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:23.717511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:23.723793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:23.725057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:23.725891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:23.728618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 487/967] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 25 04:54:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:23.736856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:23.760768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ae603-5d8d-45d6-b806-9ea249095a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:23.761407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ae603-5d8d-45d6-b806-9ea249095a97 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.761681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ae603-5d8d-45d6-b806-9ea249095a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.761948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ae603-5d8d-45d6-b806-9ea249095a97 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.762650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ae603-5d8d-45d6-b806-9ea249095a97 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:23.762952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ae603-5d8d-45d6-b806-9ea249095a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:23.764520 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ae603-5d8d-45d6-b806-9ea249095a97 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:23.812315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 481/968] 10.222.0.45 () {56 vars in 1101 bytes} [Thu Aug 25 04:54:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:23.865015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25832c8-bf32-476d-ae24-243f70c9a4c8 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:23.906330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492782a2-6554-4548-932e-795b852513cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:23.907211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492782a2-6554-4548-932e-795b852513cc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.907664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492782a2-6554-4548-932e-795b852513cc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.908138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492782a2-6554-4548-932e-795b852513cc None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.908995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492782a2-6554-4548-932e-795b852513cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:23.909452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492782a2-6554-4548-932e-795b852513cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:23.912115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492782a2-6554-4548-932e-795b852513cc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:23.928198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e40929-7526-49c8-b3eb-7b458b813e6a None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.928198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e40929-7526-49c8-b3eb-7b458b813e6a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.928198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e40929-7526-49c8-b3eb-7b458b813e6a None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.928198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 482/970] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:23.928686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 488/970] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 25 04:54:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:23.934015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfbc4b-891f-49b8-887d-40ac62494b9f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:23.934353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfbc4b-891f-49b8-887d-40ac62494b9f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:23.934583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfbc4b-891f-49b8-887d-40ac62494b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:23.935082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e40929-7526-49c8-b3eb-7b458b813e6a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:23.960670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a1bfbc4b-891f-49b8-887d-40ac62494b9f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:23.962257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a1bfbc4b-891f-49b8-887d-40ac62494b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:24.037604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:24.059972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 489/971] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:24.072946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e40929-7526-49c8-b3eb-7b458b813e6a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.110391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.111008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.111281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.111554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.115534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:24.123846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.125425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:24.145145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:24.146160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:24.147212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:24.147212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:24.147212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:24.147212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 483/972] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:24.154146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfbc4b-891f-49b8-887d-40ac62494b9f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.255918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfbc4b-891f-49b8-887d-40ac62494b9f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.289995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.290598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.290872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.291138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.291771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:24.292097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.293513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.309605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 490/973] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:24.311351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.361306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.412944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:24.416074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faedff0-90fa-4014-a5c9-e67e47398070 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.450214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b086bc1-4f2e-48af-96a9-8b5406277de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.450845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086bc1-4f2e-48af-96a9-8b5406277de4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.451120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086bc1-4f2e-48af-96a9-8b5406277de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.451392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086bc1-4f2e-48af-96a9-8b5406277de4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.459155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b086bc1-4f2e-48af-96a9-8b5406277de4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.460682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b086bc1-4f2e-48af-96a9-8b5406277de4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.467835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7c871-bd61-4f04-b65f-7f55e280f669 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-7b086bc1-4f2e-48af-96a9-8b5406277de4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:24.471563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:24.473295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 484/974] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:24.475226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dfcb7-c2b5-4e67-b37d-f3a73acdfdcb None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.476204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dfcb7-c2b5-4e67-b37d-f3a73acdfdcb None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.476204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945dfcb7-c2b5-4e67-b37d-f3a73acdfdcb None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.477086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 485/975] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:24.481912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dfcb7-c2b5-4e67-b37d-f3a73acdfdcb None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.502572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c111246-8b58-432f-a6ba-61a3fb654064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.503454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111246-8b58-432f-a6ba-61a3fb654064 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.503940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111246-8b58-432f-a6ba-61a3fb654064 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.504350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111246-8b58-432f-a6ba-61a3fb654064 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.505227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c111246-8b58-432f-a6ba-61a3fb654064 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.507397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c111246-8b58-432f-a6ba-61a3fb654064 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-6c111246-8b58-432f-a6ba-61a3fb654064 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:24.520904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:24.522077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:24.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 491/976] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:24.524771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85da8-b7da-46b1-86bf-01de07481779 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.525238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85da8-b7da-46b1-86bf-01de07481779 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.525732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85da8-b7da-46b1-86bf-01de07481779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.535080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:24.545860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b6c85da8-b7da-46b1-86bf-01de07481779 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:24.547833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b6c85da8-b7da-46b1-86bf-01de07481779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:24.592470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945dfcb7-c2b5-4e67-b37d-f3a73acdfdcb None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.614924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 492/977] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:24.615782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c85da8-b7da-46b1-86bf-01de07481779 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.637698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.638314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.638594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.638867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.639598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:24.639926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.641658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.660282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 486/978] 10.222.0.45 () {56 vars in 1149 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:24.664706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:24.665860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.732777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c85da8-b7da-46b1-86bf-01de07481779 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.771794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.772382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.772666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.772956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.773548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:24.773854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.774127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d23af-b2c0-4a15-a43b-ae0a3428b713 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.775229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.780676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 493/979] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:24.782900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:24.786530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.810499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.811112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.811437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.811713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.881512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.883125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.892117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a8b0-b285-4f05-bd46-5a59caabc154 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:24.901895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:24.927288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:24.927895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:24.928201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:24.928473 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:24.929099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:24.929402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:24.930821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:24.936203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 494/980] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:24.937031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.984997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 487/981] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:54:24.985983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:24.993921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:25.040205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022038b-ce36-4011-a0e8-0828a708d1d0 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.074179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.074838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.075111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.075383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.076063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.077396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.084813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2db50-a6b7-4ea0-a144-3a19efe338a3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.117888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.118486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.118780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.119030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.119729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] RBAC: Adding query filter params (interface=admin, service_id=f8d781950f9647d7a0e7355f033aee2e, region_id=RegionOne) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:25.120070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.121425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.126242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 488/982] 10.222.0.45 () {56 vars in 1249 bytes} [Thu Aug 25 04:54:24 2022] GET /identity/v3/endpoints?service_id=f8d781950f9647d7a0e7355f033aee2e&interface=admin®ion_id=RegionOne => generated 193 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:25.127050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:25.155223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 495/983] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:54:24 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:25.156146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:25.193124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:25.205607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:25.238787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74ea2-3ec1-490d-a9d8-a7d463259d87 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.282539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0c98f-abbd-4dfd-a8d6-335d6f0d26a6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.283502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.284297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.284924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.286218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.297274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.298676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:25.315150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:25.316363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:25.317290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:25.317290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:25.317290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:25.317290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 489/984] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:25.321914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:25.335739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.336396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.336669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.336938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.337546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.338911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.345453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 496/985] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:25 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 04:54:25.442754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d7937-98ef-45c7-8c5b-8082be247750 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.462717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:25.482201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.482923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.483393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.483746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.484510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:25.484892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.486366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.501427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 490/986] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:25.507168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:25.606035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:25.615155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83877c3-5768-463e-8214-7f1e07623dc3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.650614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.651335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.651683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.652054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.658959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.660633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:25.671938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:25.673025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:25.674123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:25.679385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 497/987] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:25.680903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:25.784610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25151618-1bb9-4f55-919a-d4f1603d3888 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.820256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a36005-c1c0-4847-b3d7-0e35bfee718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.820872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a36005-c1c0-4847-b3d7-0e35bfee718b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.821150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a36005-c1c0-4847-b3d7-0e35bfee718b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.821418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a36005-c1c0-4847-b3d7-0e35bfee718b None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.822110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a36005-c1c0-4847-b3d7-0e35bfee718b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:25.822414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a36005-c1c0-4847-b3d7-0e35bfee718b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.823856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a36005-c1c0-4847-b3d7-0e35bfee718b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.839972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 491/988] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:25.842673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:25.944761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f47c-194a-4338-9211-9af00d4e1c93 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:25.978858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c405b-2710-42e9-9c35-71f6a547762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:25.979458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c405b-2710-42e9-9c35-71f6a547762d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:25.979735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c405b-2710-42e9-9c35-71f6a547762d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:25.980036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c405b-2710-42e9-9c35-71f6a547762d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:25.980751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c405b-2710-42e9-9c35-71f6a547762d None admin] RBAC: Adding query filter params (role.id=bf4489619afb44eda29600a33a606567, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=6e73a2cbe56e4cc7b8d52e53300bd809) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:25.981054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c405b-2710-42e9-9c35-71f6a547762d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:25.982503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c405b-2710-42e9-9c35-71f6a547762d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:25.988992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 498/989] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:25 2022] GET /identity/v3/role_assignments?user.id=6e73a2cbe56e4cc7b8d52e53300bd809&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=bf4489619afb44eda29600a33a606567 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:27.094891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014fb09-e2b8-453d-9ae3-79c874b507a3 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.095451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014fb09-e2b8-453d-9ae3-79c874b507a3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.095451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014fb09-e2b8-453d-9ae3-79c874b507a3 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.099958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 492/990] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:27.103692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012545-1a52-43d1-a7d0-db26f46f87d0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.104120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012545-1a52-43d1-a7d0-db26f46f87d0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.104283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012545-1a52-43d1-a7d0-db26f46f87d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.122574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-66012545-1a52-43d1-a7d0-db26f46f87d0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:27.123765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-66012545-1a52-43d1-a7d0-db26f46f87d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:27.135647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:27.199951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 499/991] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:27.296812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7c8f-02d3-47bf-9f23-99baabb8a9a3 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.297123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7c8f-02d3-47bf-9f23-99baabb8a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.297377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7c8f-02d3-47bf-9f23-99baabb8a9a3 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.298865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 493/992] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:27.304283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab5f4-3d24-498c-8cc5-5d3597fef3ff None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.304571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab5f4-3d24-498c-8cc5-5d3597fef3ff None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.304847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ab5f4-3d24-498c-8cc5-5d3597fef3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.322995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b40ab5f4-3d24-498c-8cc5-5d3597fef3ff None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:27.324343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b40ab5f4-3d24-498c-8cc5-5d3597fef3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:27.390774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 500/993] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:27.470545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb7c8f-02d3-47bf-9f23-99baabb8a9a3 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:27.513495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:27.575723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb7c8f-02d3-47bf-9f23-99baabb8a9a3 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:27.613668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:27.614313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.614592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.614864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.615450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:27.616866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:27.625705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:27.626711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:27.627574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:27.631805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 494/994] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:27.632867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab5f4-3d24-498c-8cc5-5d3597fef3ff None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:27.675205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:27.725561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:27.750109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ab5f4-3d24-498c-8cc5-5d3597fef3ff None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:27.785602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:27.786457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.786739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.787038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.788199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:27.788626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:27.790660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:27.793113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37215093-c368-4c39-826a-353eda0ff72f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:27.794779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:27.803230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 501/995] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:27.804292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:27.830267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:27.830904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.831194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.831464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.833212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:27.834615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:27.843439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:27.844457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:27.845413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 495/996] 10.222.0.45 () {56 vars in 1126 bytes} [Thu Aug 25 04:54:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:27.851507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:27.928829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5437f21-0ef2-4a6f-9dd6-740cf0b6e542 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:27.959194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac28a9-c383-4b39-95e2-cd5926de69c2 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:27.964441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942fdcf-809c-4d06-bbf0-5862c10ec64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:27.965045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942fdcf-809c-4d06-bbf0-5862c10ec64c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.965323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942fdcf-809c-4d06-bbf0-5862c10ec64c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.965592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942fdcf-809c-4d06-bbf0-5862c10ec64c None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.966220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942fdcf-809c-4d06-bbf0-5862c10ec64c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:27.966518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942fdcf-809c-4d06-bbf0-5862c10ec64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:27.967885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942fdcf-809c-4d06-bbf0-5862c10ec64c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:27.973723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 502/997] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:27.977258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539e217-b8bc-45b0-b74a-8b6b4b7a405a None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.977544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539e217-b8bc-45b0-b74a-8b6b4b7a405a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.977814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539e217-b8bc-45b0-b74a-8b6b4b7a405a None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:27.979191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 503/998] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:27.979782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539e217-b8bc-45b0-b74a-8b6b4b7a405a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:27.983602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:27.998076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345add11-62eb-47d4-bcfa-a3d054f71650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:27.998689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345add11-62eb-47d4-bcfa-a3d054f71650 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:27.998971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345add11-62eb-47d4-bcfa-a3d054f71650 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:27.999244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345add11-62eb-47d4-bcfa-a3d054f71650 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.004168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345add11-62eb-47d4-bcfa-a3d054f71650 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:28.004168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345add11-62eb-47d4-bcfa-a3d054f71650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.004168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345add11-62eb-47d4-bcfa-a3d054f71650 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.007408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 496/999] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:28.008712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf485458-f2c2-465a-846c-30b110affa04 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.008999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf485458-f2c2-465a-846c-30b110affa04 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.009280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf485458-f2c2-465a-846c-30b110affa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.028537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cf485458-f2c2-465a-846c-30b110affa04 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:28.029741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cf485458-f2c2-465a-846c-30b110affa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:28.055450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:28.082908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539e217-b8bc-45b0-b74a-8b6b4b7a405a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:28.101159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 497/1000] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:28.101996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf485458-f2c2-465a-846c-30b110affa04 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:28.119577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:28.120226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.120511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.120790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.121524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] RBAC: Adding query filter params (interface=public, service_id=ae5e34884ad24254a3ca92304268f3a9, region_id=RegionOne) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:28.121815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.123199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.131948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 504/1001] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:54:27 2022] GET /identity/v3/endpoints?service_id=ae5e34884ad24254a3ca92304268f3a9&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:28.133813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:28.205601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:28.207009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf485458-f2c2-465a-846c-30b110affa04 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:28.242063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7994df-4811-43cb-baef-22d4c5da2971 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:28.242618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:28.243234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.243512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.243783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.244446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:28.244746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.246124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.255486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 498/1002] 10.222.0.45 () {56 vars in 1122 bytes} [Thu Aug 25 04:54:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:28.256496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:28.282969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:28.283961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:28.285040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.285327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.285602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.286376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.288419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.305894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 505/1003] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:28 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 04:54:28.368336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80f245-cdb0-44d5-874a-1908cd25dbc9 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:28.370088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:28.408352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:28.408973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.409276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.409517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.411202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.412725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.481555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffac0b-3960-4992-9635-d47c75e8ed0f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:28.511502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:28.515181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 499/1004] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:28.533468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:28.534136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.534418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.534786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] PATH_INFO: `/v3/services/image` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.535868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.537483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:28.547373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:28.551426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:28.552664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 506/1005] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Aug 25 04:54:28 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:28.555198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:28.654705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:28.674552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63994d7b-ee42-466b-b6c3-2ae04ec3361e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:28.714343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b3f30-68a5-4ea4-8869-7243e06adfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:28.714960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b3f30-68a5-4ea4-8869-7243e06adfee None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.715235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b3f30-68a5-4ea4-8869-7243e06adfee None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.715505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b3f30-68a5-4ea4-8869-7243e06adfee None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.716193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b3f30-68a5-4ea4-8869-7243e06adfee None admin] RBAC: Adding query filter params (name=image) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:28.716496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b3f30-68a5-4ea4-8869-7243e06adfee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.717879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b3f30-68a5-4ea4-8869-7243e06adfee None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.723091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 500/1006] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:28.729611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:28.840209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33130eb-1f7f-4b1f-8689-1ba2f75bff23 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:28.876321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c828-e3a2-4e3c-928e-f30ae509e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:28.876939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c828-e3a2-4e3c-928e-f30ae509e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:28.877221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c828-e3a2-4e3c-928e-f30ae509e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:28.877496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c828-e3a2-4e3c-928e-f30ae509e7d7 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:28.878131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c828-e3a2-4e3c-928e-f30ae509e7d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:28.878465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c828-e3a2-4e3c-928e-f30ae509e7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:28.880018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c828-e3a2-4e3c-928e-f30ae509e7d7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:28.887987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 507/1007] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:30.226257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eaf33-3eb5-48f9-a50e-82feec2a04eb None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.226859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eaf33-3eb5-48f9-a50e-82feec2a04eb None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.226859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369eaf33-3eb5-48f9-a50e-82feec2a04eb None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.228307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 501/1008] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:30.233405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d1e38-2cf6-4302-8e37-fdf76c5ff9f2 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.233803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d1e38-2cf6-4302-8e37-fdf76c5ff9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.234004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d1e38-2cf6-4302-8e37-fdf76c5ff9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.252233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-323d1e38-2cf6-4302-8e37-fdf76c5ff9f2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:30.253944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-323d1e38-2cf6-4302-8e37-fdf76c5ff9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:30.305022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:30.323289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 508/1009] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:30.500792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09470-d180-4b9c-8ccc-8c86c5829460 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.501154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09470-d180-4b9c-8ccc-8c86c5829460 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.501341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec09470-d180-4b9c-8ccc-8c86c5829460 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.502827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 502/1010] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:30.508361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a56fd8-214c-44b4-b054-8e6186eebf18 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.508652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a56fd8-214c-44b4-b054-8e6186eebf18 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.509028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a56fd8-214c-44b4-b054-8e6186eebf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.527711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-83a56fd8-214c-44b4-b054-8e6186eebf18 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:30.528936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-83a56fd8-214c-44b4-b054-8e6186eebf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:30.589707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec09470-d180-4b9c-8ccc-8c86c5829460 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:30.598625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 509/1011] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:30.704606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec09470-d180-4b9c-8ccc-8c86c5829460 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:30.740841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a05b94-6874-4c1c-abf1-cd852c3592f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:30.741465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05b94-6874-4c1c-abf1-cd852c3592f7 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.741738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05b94-6874-4c1c-abf1-cd852c3592f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.742005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05b94-6874-4c1c-abf1-cd852c3592f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.742580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a05b94-6874-4c1c-abf1-cd852c3592f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:30.743964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a05b94-6874-4c1c-abf1-cd852c3592f7 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-76a05b94-6874-4c1c-abf1-cd852c3592f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:30.752590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:30.753725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 04:54:30.755366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:30.758803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 503/1012] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:30.760194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a56fd8-214c-44b4-b054-8e6186eebf18 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:30.792329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26ae43-f035-4ea9-aa45-2b2bdb96cc7c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.792663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26ae43-f035-4ea9-aa45-2b2bdb96cc7c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.792990 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26ae43-f035-4ea9-aa45-2b2bdb96cc7c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.794499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 504/1013] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:30.799204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd42af-0d54-4754-98b3-2d7a581e3dcc None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.799487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd42af-0d54-4754-98b3-2d7a581e3dcc None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.799764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd42af-0d54-4754-98b3-2d7a581e3dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.817759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b3dd42af-0d54-4754-98b3-2d7a581e3dcc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:30.818958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b3dd42af-0d54-4754-98b3-2d7a581e3dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:30.827118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:30.868770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a56fd8-214c-44b4-b054-8e6186eebf18 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:30.885630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:30.896002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 505/1014] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:30.896863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd42af-0d54-4754-98b3-2d7a581e3dcc None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:30.904479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:30.905730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:30.906250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:30.907093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:30.907999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:30.908788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:30.910848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:30.919352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 510/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:30.922956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:31.005222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd42af-0d54-4754-98b3-2d7a581e3dcc None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:31.031245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830d8f-af33-4d6b-81db-5131eb4f2e5e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:31.041546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:31.042254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:31.042616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:31.042889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:31.044037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:31.045611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:31.047489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 506/1016] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:31.053199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:31.065113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:31.066494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:31.067179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:31.067460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:31.067735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:31.068411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:31.068715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:31.070090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:31.075050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 511/1017] 10.222.0.45 () {56 vars in 1112 bytes} [Thu Aug 25 04:54:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:31.085163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:31.133500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:31.160926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c228aa-dd01-4b5c-b7f1-de2405dbaf55 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:31.190567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf4df-7468-452c-9239-cfebaa770062 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:31.195230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:31.195839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:31.196146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:31.196418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:31.197062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:31.198548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:31.225679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9a232-7406-4707-b892-a36a7a356427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:31.226284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a232-7406-4707-b892-a36a7a356427 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:31.226626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a232-7406-4707-b892-a36a7a356427 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:31.226908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a232-7406-4707-b892-a36a7a356427 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:31.227562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9a232-7406-4707-b892-a36a7a356427 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:31.228997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9a232-7406-4707-b892-a36a7a356427 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:31.280353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 507/1018] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:54:31 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:31.281103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:31.313472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 512/1019] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:31.353950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:31.402773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba4bcd-7747-414e-be8f-cee622acc4bb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:31.449932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e942558-e651-4a2f-844f-4a20aa5f9523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:31.450652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e942558-e651-4a2f-844f-4a20aa5f9523 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:31.450999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e942558-e651-4a2f-844f-4a20aa5f9523 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:31.451328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e942558-e651-4a2f-844f-4a20aa5f9523 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:31.452101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e942558-e651-4a2f-844f-4a20aa5f9523 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:31.453547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e942558-e651-4a2f-844f-4a20aa5f9523 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:31.619522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 508/1020] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:54:31 2022] POST /identity/v3/services => generated 242 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:33.266481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e362e-1da6-482e-95ed-9ead32d2da89 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.267033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e362e-1da6-482e-95ed-9ead32d2da89 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.267033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e362e-1da6-482e-95ed-9ead32d2da89 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.268617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 513/1021] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:33.273831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5750e0-4308-4928-a4e7-905a4471d4e5 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.274232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5750e0-4308-4928-a4e7-905a4471d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.274393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5750e0-4308-4928-a4e7-905a4471d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.293097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cf5750e0-4308-4928-a4e7-905a4471d4e5 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:33.294277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cf5750e0-4308-4928-a4e7-905a4471d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:33.369671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 509/1022] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:33.413064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbda59-177e-4d4c-80d2-e41466ec1c44 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.413370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbda59-177e-4d4c-80d2-e41466ec1c44 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.413618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbda59-177e-4d4c-80d2-e41466ec1c44 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.415105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 514/1023] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:33.420182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5ec4-868a-4eb6-a687-1398ae7765ed None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.420472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5ec4-868a-4eb6-a687-1398ae7765ed None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.420742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5ec4-868a-4eb6-a687-1398ae7765ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.438964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0a4e5ec4-868a-4eb6-a687-1398ae7765ed None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:33.440173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0a4e5ec4-868a-4eb6-a687-1398ae7765ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:33.487458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:33.514434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 510/1024] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:33.573582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6edd-8f0e-494a-b190-e789247abb24 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.573867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6edd-8f0e-494a-b190-e789247abb24 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.574052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6edd-8f0e-494a-b190-e789247abb24 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.575544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 515/1025] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:33.580628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ebf9-305e-4d79-b250-058611a398d9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.580921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ebf9-305e-4d79-b250-058611a398d9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.581197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553ebf9-305e-4d79-b250-058611a398d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.600334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3553ebf9-305e-4d79-b250-058611a398d9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:33.601517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3553ebf9-305e-4d79-b250-058611a398d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:33.648954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b6edd-8f0e-494a-b190-e789247abb24 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:33.673621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 511/1026] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:33.760354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:33.764522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b6edd-8f0e-494a-b190-e789247abb24 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:33.785855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ebf9-305e-4d79-b250-058611a398d9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:33.801316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:33.802231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.802734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.803183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.804498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:33.806243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:33.808214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 516/1027] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:33.813533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:33.895937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553ebf9-305e-4d79-b250-058611a398d9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:33.899585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:33.923573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaf742-ac17-4c55-952a-45fc8d7cea2e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:33.931640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:33.932311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.932593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.932868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.944906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:33.949587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:33.950552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:33.951559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 512/1028] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 25 04:54:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:33.952482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:33.961434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:33.962042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:33.962323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:33.962596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:33.963244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:33.964773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.053267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a714-1ee5-410b-85b1-9145a85f7ade None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.069191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 517/1029] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:54:33 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:54:34.070381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.094102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.094763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.095040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.095308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] PATH_INFO: `/v3/services/image` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.095943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.097375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.101602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:34.108682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:34.114079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:34.114998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 513/1030] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Aug 25 04:54:33 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:34.117167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.154348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:34.190351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed9c7e-385d-49d8-b3ec-d6937c116d5d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.236647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.237272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.237552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.237863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.238090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270581e3-5364-42bb-8446-338ff6302e5a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.238723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:34.239039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.240490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.249464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 518/1031] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:34.255827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.278537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.279260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.279546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.279822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.280497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] RBAC: Adding query filter params (name=image) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:34.280797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.282686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.289806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 514/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:34.295193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.361467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:34.377137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb5c36-d012-41c0-8fde-e9e6ef7f7384 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.401147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:34.415223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb6e3a-3abb-4d1c-be40-3c0f1f99db58 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.415613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.416333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.416613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.416887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.428036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.429514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:34.445556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:34.446545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:34.447438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:34.447438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:34.447438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:34.447438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 519/1033] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:34.452573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.454110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.454723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.454997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.455438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.457225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:34.457542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.458953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.464671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 515/1034] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:34.470344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.582350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351c02-4ffc-4da8-8e0a-bee75d3fc75d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.585516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6601f-2225-4f12-961f-45c0ba7967f0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.618607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.619220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.619503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.619779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.620474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:34.620771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.622150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.623517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.624426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.624707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.624982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.625680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] RBAC: Adding query filter params (interface=public, service_id=072bfd7607e340bba118ddd30f5751a2, region_id=RegionOne) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:34.625989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.627348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.630165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:34.638448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 516/1035] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/endpoints?service_id=072bfd7607e340bba118ddd30f5751a2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:34.644250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 520/1036] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:34.644419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.644547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.664880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:34.753997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9b7e1-58b7-44ca-82c9-a8d4db46e464 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.754237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e943e6a-bb5c-4e22-ba27-213c4d24c926 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.790783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.790991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.791392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.791519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.791696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.791793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.791962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.792060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.792661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.794202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.798978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.801024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:34.802237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 521/1037] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:34.815748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:34.822443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:34.823472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 517/1038] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:34.824159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:34.912139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:34.954799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0221a-d5ed-4e56-ad6c-f2ac278f1057 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:34.993371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:34.993988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:34.994267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:34.994541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:34.995279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:34.995587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:34.997083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:35.015495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 522/1039] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:54:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:35.021620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:35.107342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:35.126932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc122152-f770-47e8-872b-105c020aab74 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:35.163241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:35.163851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:35.164157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:35.164435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:35.235387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:35.236882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:35.319447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:35.339353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 518/1040] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 04:54:35.345072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:35.449979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cad39-6501-4e24-85e2-a1c58cfc1a24 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:35.471406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:35.486074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:35.486698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:35.486987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:35.487261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:35.497625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:35.499093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:35.514457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:35.515450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:35.516426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:35.516426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:35.516426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:35.517131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 523/1041] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:35.521975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:35.620466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4a7f-a901-4cae-b862-364afe9bf5d5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:35.655063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:35.655673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:35.655977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:35.656252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:35.656898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:35.657202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:35.658584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:35.674663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 519/1042] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:35.677090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:35.782608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf18a79-3049-4b6a-aa96-655162062365 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:35.817390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:35.818028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:35.818305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:35.818573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:35.825540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:35.826982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:35.838348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:35.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:35.840689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:35.844213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 524/1043] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:35.845466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:35.892666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:35.952326 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7207b5-c230-41ec-afd5-5a0ee656e356 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:35.985342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff7dcb-0bbf-49a7-b134-57437016ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:35.985943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7dcb-0bbf-49a7-b134-57437016ee1d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:35.986217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7dcb-0bbf-49a7-b134-57437016ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:35.986484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff7dcb-0bbf-49a7-b134-57437016ee1d None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:35.987165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff7dcb-0bbf-49a7-b134-57437016ee1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:35.987463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff7dcb-0bbf-49a7-b134-57437016ee1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:35.989434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff7dcb-0bbf-49a7-b134-57437016ee1d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:36.001465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 520/1044] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:36.007496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:36.041694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:36.066125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277594d-c45b-4507-9f73-f27d471e2aff None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.066417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277594d-c45b-4507-9f73-f27d471e2aff None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.066686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277594d-c45b-4507-9f73-f27d471e2aff None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.068158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 521/1045] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:36.073139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f27a-2eea-468a-8b6e-ad00120d430b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.073443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f27a-2eea-468a-8b6e-ad00120d430b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.073721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895f27a-2eea-468a-8b6e-ad00120d430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.092206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3895f27a-2eea-468a-8b6e-ad00120d430b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:36.093383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3895f27a-2eea-468a-8b6e-ad00120d430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:36.117950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f6c18-5110-4525-9480-a4ef1093ba46 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:36.155534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:36.156497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.157043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.157655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.158457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] RBAC: Adding query filter params (role.id=bf4489619afb44eda29600a33a606567, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=89cfa7e2f08741d4938a017990b8b031) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:36.158842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:36.160461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:36.165355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 522/1046] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:36.175949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 525/1047] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:36 2022] GET /identity/v3/role_assignments?user.id=89cfa7e2f08741d4938a017990b8b031&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=bf4489619afb44eda29600a33a606567 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:36.437913 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895f27a-2eea-468a-8b6e-ad00120d430b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:36.468968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:36.548490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895f27a-2eea-468a-8b6e-ad00120d430b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:36.583409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f38d9-0648-4dcd-8e49-5a210231af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:36.584076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f38d9-0648-4dcd-8e49-5a210231af85 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.584355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f38d9-0648-4dcd-8e49-5a210231af85 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.584626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f38d9-0648-4dcd-8e49-5a210231af85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.596454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f38d9-0648-4dcd-8e49-5a210231af85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-3e0f38d9-0648-4dcd-8e49-5a210231af85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:36.600179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:36.601135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:36.601992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:36.604261 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 523/1048] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:36.607209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:36.710967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:36.716621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa2df6-953d-49ca-baf7-8567e065b91a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:36.731373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd244459-cf42-449d-8651-6f7b77bdecbf None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.731675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd244459-cf42-449d-8651-6f7b77bdecbf None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.731991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd244459-cf42-449d-8651-6f7b77bdecbf None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.733471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 524/1049] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:36.739205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8aa4a-5163-4fec-bc86-4d93cfb102e7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.740015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8aa4a-5163-4fec-bc86-4d93cfb102e7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.740302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8aa4a-5163-4fec-bc86-4d93cfb102e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.758165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2da8aa4a-5163-4fec-bc86-4d93cfb102e7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:36.759133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:36.759351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2da8aa4a-5163-4fec-bc86-4d93cfb102e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:36.759744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.760053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.760326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.760985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:36.761465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:36.763612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:36.774095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 526/1050] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:54:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:36.779804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:36.837067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 525/1051] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:36.885386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66fa3a-408c-4ec9-9fb0-929092d2f923 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:36.924115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:36.924735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:36.925009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:36.925343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] PATH_INFO: `/v3/users/37841c17b78a4018a1d1f1295e98f9b7` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:36.938624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] RBAC: Authorizing `identity:get_user(user_id=37841c17b78a4018a1d1f1295e98f9b7)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:36.940087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:36.947229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 527/1052] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:36 2022] GET /identity/v3/users/37841c17b78a4018a1d1f1295e98f9b7 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:36.948161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8aa4a-5163-4fec-bc86-4d93cfb102e7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:36.970565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:37.048230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8aa4a-5163-4fec-bc86-4d93cfb102e7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:37.081376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:37.082165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:37.082439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:37.082709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:37.109982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:37.133810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:37.156571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:37.158198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:37.181761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:37.221378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d581e-8528-45a8-ac48-a7d900de6b2e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:37.259808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:37.260787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:37.261265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:37.261547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] PATH_INFO: `/v3/services/image` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:37.262124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:37.263498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:37.267228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 526/1053] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 04:54:37.273554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:37.277646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:37.278639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:37.284162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 528/1054] 10.222.0.45 () {56 vars in 1105 bytes} [Thu Aug 25 04:54:37 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:37.285336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:37.369695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:37.382912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6c20a-9ff8-4c80-9f11-d46e14069192 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:37.388901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b0b53-1940-4e94-bee1-f16bd6b82082 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:37.404419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:37.418873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:37.419501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:37.419773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:37.420074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:37.421246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] RBAC: Authorizing `identity:get_project(project_id=ac17919dafab40399fffd0227b4218e6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:37.422695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:37.424335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 527/1055] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:54:37 2022] GET /identity/v3/projects/ac17919dafab40399fffd0227b4218e6 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:37.430814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:37.432206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:37.437549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:37.437549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:37.437549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:37.437549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:37.437549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:37.437549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:37.441867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 529/1056] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:37.447454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:37.542144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b66413-f529-4b13-824e-85690b46557e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:37.548749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb56e2-c081-42b1-8611-6971aef2d9a7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:37.579325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:37.579948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:37.580229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:37.580516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:37.581234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=ac17919dafab40399fffd0227b4218e6, user.id=37841c17b78a4018a1d1f1295e98f9b7) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:37.581561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:37.582973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:37.583340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41e1c3-8de5-41d7-82b1-87fe571029e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:37.583963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41e1c3-8de5-41d7-82b1-87fe571029e2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:37.584244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41e1c3-8de5-41d7-82b1-87fe571029e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:37.584564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41e1c3-8de5-41d7-82b1-87fe571029e2 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:37.585128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41e1c3-8de5-41d7-82b1-87fe571029e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:37.585428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41e1c3-8de5-41d7-82b1-87fe571029e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:37.586785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41e1c3-8de5-41d7-82b1-87fe571029e2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:37.598128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 528/1057] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:37 2022] GET /identity/v3/role_assignments?user.id=37841c17b78a4018a1d1f1295e98f9b7&scope.project.id=ac17919dafab40399fffd0227b4218e6&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:37.598350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 530/1058] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:37.598436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:37.657592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:37.714150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650ffbd-840d-4b1f-8b0c-f12cba2c995b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:37.755060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06cbf0-385b-4179-aa23-2b60fa78df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:37.755683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06cbf0-385b-4179-aa23-2b60fa78df4f None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:37.756132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06cbf0-385b-4179-aa23-2b60fa78df4f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:37.756414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06cbf0-385b-4179-aa23-2b60fa78df4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:37.757091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06cbf0-385b-4179-aa23-2b60fa78df4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:37.758485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06cbf0-385b-4179-aa23-2b60fa78df4f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:37.853700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 529/1059] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:54:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:38.077722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250fcda-054e-4d52-a071-c6d0496abd27 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:38.078229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250fcda-054e-4d52-a071-c6d0496abd27 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:38.078308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250fcda-054e-4d52-a071-c6d0496abd27 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:38.079801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 531/1060] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:38.084930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe28a4-ce06-442e-a33f-900cbd2dd044 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:38.085221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe28a4-ce06-442e-a33f-900cbd2dd044 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:38.085498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe28a4-ce06-442e-a33f-900cbd2dd044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:38.103672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-38fe28a4-ce06-442e-a33f-900cbd2dd044 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:38.104954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-38fe28a4-ce06-442e-a33f-900cbd2dd044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:38.177688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 530/1061] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:38.449101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250fcda-054e-4d52-a071-c6d0496abd27 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:38.460306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:38.555735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250fcda-054e-4d52-a071-c6d0496abd27 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:38.590663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:38.591293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:38.591574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:38.591847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:38.603060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:38.607757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:38.608814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:38.609674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:38.610882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 532/1062] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 25 04:54:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:38.615382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe28a4-ce06-442e-a33f-900cbd2dd044 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:38.649675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:38.728795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe28a4-ce06-442e-a33f-900cbd2dd044 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:38.769927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:38.770530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:38.770803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:38.771069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:38.771783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:38.772116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:38.773479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:38.786683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 531/1063] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 25 04:54:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:38.787596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:38.856943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:38.890828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282c03e-be9a-47ed-a96d-59217d8d400d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:38.930931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:38.931576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:38.931850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:38.932167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:38.944898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:38.946374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:38.961623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:38.962599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:38.963499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:38.963499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:38.963499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:38.963499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 533/1064] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:38.969840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:39.066935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:39.073615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da446d7-0551-4604-987d-04e2c0b55efb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:39.106653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:39.107737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.108438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.109238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.109882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:39.110187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:39.111559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:39.123749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 532/1065] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:39.129992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:39.231093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea716c6-4485-404d-b52b-6b28431988ca None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:39.250815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:39.265003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:39.265691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.265969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.266266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.274064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:39.275521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:39.287013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:39.288008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:39.289089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 534/1066] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:54:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:39.296024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:39.397101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7ed24-d47e-4508-b033-365f51a395f8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:39.432053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a0f74-b64b-4569-9543-9a92ede8d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:39.432650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0f74-b64b-4569-9543-9a92ede8d56e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.432927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0f74-b64b-4569-9543-9a92ede8d56e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.433197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0f74-b64b-4569-9543-9a92ede8d56e None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.433923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0f74-b64b-4569-9543-9a92ede8d56e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:39.434228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0f74-b64b-4569-9543-9a92ede8d56e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:39.435687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0f74-b64b-4569-9543-9a92ede8d56e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:39.458173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 533/1067] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:54:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:39.459679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:39.517273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef70bd-80b3-4b97-a077-9f0a795e8ca5 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.517602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef70bd-80b3-4b97-a077-9f0a795e8ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.517844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef70bd-80b3-4b97-a077-9f0a795e8ca5 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.520285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 534/1068] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:39.525102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfbede-25f1-4569-8e76-9835b0bd36a6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.525390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfbede-25f1-4569-8e76-9835b0bd36a6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.525670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfbede-25f1-4569-8e76-9835b0bd36a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.544584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-1ddfbede-25f1-4569-8e76-9835b0bd36a6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:39.545785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1ddfbede-25f1-4569-8e76-9835b0bd36a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:39.555874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:39.570656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0687d7e-5b10-4863-81d8-bfd5ac03ee9b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:39.607484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e90403-44b8-433b-be70-b6f4c08cab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:39.608156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e90403-44b8-433b-be70-b6f4c08cab5b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.608435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e90403-44b8-433b-be70-b6f4c08cab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.608711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e90403-44b8-433b-be70-b6f4c08cab5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.619070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 535/1069] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:39.620693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e90403-44b8-433b-be70-b6f4c08cab5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:39.622170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e90403-44b8-433b-be70-b6f4c08cab5b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-46e90403-44b8-433b-be70-b6f4c08cab5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:39.637057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:39.638036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:39.638971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:39.638971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:39.638971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:39.638971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 535/1070] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:39.644476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfbede-25f1-4569-8e76-9835b0bd36a6 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:39.751949 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfbede-25f1-4569-8e76-9835b0bd36a6 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:39.777810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54eb33-c56e-402c-9c6a-d8c52e008514 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.778039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54eb33-c56e-402c-9c6a-d8c52e008514 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.778288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54eb33-c56e-402c-9c6a-d8c52e008514 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.779778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 536/1071] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 04:54:39.784391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e10fe-c0cd-4146-996b-61e2875f05f4 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.784674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e10fe-c0cd-4146-996b-61e2875f05f4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.784949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e10fe-c0cd-4146-996b-61e2875f05f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.787156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:39.787768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:39.788076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:39.788346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:39.788988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:39.789288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:39.790652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:39.802663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 536/1072] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:39.804830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-689e10fe-c0cd-4146-996b-61e2875f05f4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:39.806023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-689e10fe-c0cd-4146-996b-61e2875f05f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:39.808240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:39.812526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:39.835685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:39.888883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 537/1073] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:39.901016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e10fe-c0cd-4146-996b-61e2875f05f4 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:39.946807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e809057-3019-4046-9330-e0b8bf4e946f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.000008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.001041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.001331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.001608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.009444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.010938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.019042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e10fe-c0cd-4146-996b-61e2875f05f4 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:40.023334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:40.024443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:40.025391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:40.028271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 537/1074] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:40.029859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.077210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.078243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.078722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.079191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.091403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:40.096418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:40.098109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:40.098956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:40.099596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.099668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 538/1075] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:40.104947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.130712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.144377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88ace1-ec2e-4728-ac51-2f71852adad6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.181945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.182575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.182857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.183140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.184340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:40.184879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.187561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.202933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 538/1076] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:40.211132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.223741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fac8b-2ab1-418b-a53d-f8f4aadc08bc None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.260855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.261560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.261898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.262239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.262961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:40.263325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.264717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.273578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 539/1077] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:40.274364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.314786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15f059-0799-443a-8ae9-fd105b405d26 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.337991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.349095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.349753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.350283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.350553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/89cfa7e2f08741d4938a017990b8b031/roles/bf4489619afb44eda29600a33a606567` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.352821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=89cfa7e2f08741d4938a017990b8b031, role_id=bf4489619afb44eda29600a33a606567)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.354266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.357211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.372366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc92574-06c8-476a-a21e-34a41fd160c8 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.405192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.405783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.406058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.406323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.463472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 539/1078] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:54:40 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/89cfa7e2f08741d4938a017990b8b031/roles/bf4489619afb44eda29600a33a606567 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:54:40.464363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.470378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.472497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.571947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.578230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a30-b66a-48d0-9bbc-3bc408b752e5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.592268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 540/1079] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:54:40.598092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.621547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.622279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.622660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.623001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] PATH_INFO: `/v3/users/37841c17b78a4018a1d1f1295e98f9b7` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.624287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] RBAC: Authorizing `identity:get_user(user_id=37841c17b78a4018a1d1f1295e98f9b7)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.625729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.627331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 540/1080] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:40 2022] GET /identity/v3/users/37841c17b78a4018a1d1f1295e98f9b7 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:40.633977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.694394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.712078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312c963-6752-4f1a-b470-0702ad1d85df None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.748030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.748433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d50204-fb63-4312-81f9-02792696dd8f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.748663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.748936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.749206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.760344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.761814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:40.779410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:40.780480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:40.781374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:40.781374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:40.781374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:40.782066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 541/1081] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:40.788298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.790461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.791117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.791398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.791680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.792864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] RBAC: Authorizing `identity:get_project(project_id=ac17919dafab40399fffd0227b4218e6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.794319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.802021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 541/1082] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:54:40 2022] GET /identity/v3/projects/ac17919dafab40399fffd0227b4218e6 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:40.802718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:40.829637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.895148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1fcfd-4d6f-46e1-bd4f-a3c86f8c7e3e None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.911117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0fb6b-5298-47f9-9b61-7e0bd5c3ec21 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:40.930221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6d401-64c7-4387-b06a-f9199988a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.930839 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d401-64c7-4387-b06a-f9199988a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.931101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d401-64c7-4387-b06a-f9199988a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.931369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d401-64c7-4387-b06a-f9199988a6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.932045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d401-64c7-4387-b06a-f9199988a6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:40.932348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d401-64c7-4387-b06a-f9199988a6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.933712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6d401-64c7-4387-b06a-f9199988a6b7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:40.938418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:40.946911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 542/1083] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:40.960590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce417b-5f04-4404-8cc8-cee4873dc3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:40.960590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce417b-5f04-4404-8cc8-cee4873dc3c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:40.960860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce417b-5f04-4404-8cc8-cee4873dc3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:40.960997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce417b-5f04-4404-8cc8-cee4873dc3c7 None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6/users/37841c17b78a4018a1d1f1295e98f9b7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:40.963469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce417b-5f04-4404-8cc8-cee4873dc3c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac17919dafab40399fffd0227b4218e6, user_id=37841c17b78a4018a1d1f1295e98f9b7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:40.965018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce417b-5f04-4404-8cc8-cee4873dc3c7 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:41.053503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 542/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:54:40 2022] PUT /identity/v3/projects/ac17919dafab40399fffd0227b4218e6/users/37841c17b78a4018a1d1f1295e98f9b7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 04:54:42.387046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff006d8-f2e6-4872-a6dd-17964961ee67 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:42.387569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff006d8-f2e6-4872-a6dd-17964961ee67 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:42.387569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff006d8-f2e6-4872-a6dd-17964961ee67 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:42.389123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 543/1085] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:42.394290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c79e8-0649-438f-b990-a286644d629c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:42.394671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c79e8-0649-438f-b990-a286644d629c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:42.395023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c79e8-0649-438f-b990-a286644d629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:42.413242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9f0c79e8-0649-438f-b990-a286644d629c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:42.414442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9f0c79e8-0649-438f-b990-a286644d629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:42.481343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 543/1086] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:42.751435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff006d8-f2e6-4872-a6dd-17964961ee67 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:42.857708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:42.864764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff006d8-f2e6-4872-a6dd-17964961ee67 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:42.898653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d371f-1617-4065-a8d6-be11252e65a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:42.899270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d371f-1617-4065-a8d6-be11252e65a3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:42.899544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d371f-1617-4065-a8d6-be11252e65a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:42.899808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d371f-1617-4065-a8d6-be11252e65a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:42.909754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d371f-1617-4065-a8d6-be11252e65a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-821d371f-1617-4065-a8d6-be11252e65a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:42.914451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:42.915405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:42.916285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 544/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Thu Aug 25 04:54:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:54:42.921475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c79e8-0649-438f-b990-a286644d629c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:42.971001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034dd62-fb3d-4e02-b01a-614746b24e40 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:42.971183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034dd62-fb3d-4e02-b01a-614746b24e40 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:42.971466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034dd62-fb3d-4e02-b01a-614746b24e40 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:42.972921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 545/1088] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:42.978116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8234c6-ec88-4ee6-9279-495f11989d59 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:42.978397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8234c6-ec88-4ee6-9279-495f11989d59 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:42.978676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8234c6-ec88-4ee6-9279-495f11989d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:42.996877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5b8234c6-ec88-4ee6-9279-495f11989d59 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:42.998083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5b8234c6-ec88-4ee6-9279-495f11989d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:43.024767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c79e8-0649-438f-b990-a286644d629c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.035352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.059388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.060016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.060287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.060560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.061215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:43.061514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.062978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.064763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 546/1089] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:54:43.076301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 544/1090] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 25 04:54:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:43.077206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8234c6-ec88-4ee6-9279-495f11989d59 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.160762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.178836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8234c6-ec88-4ee6-9279-495f11989d59 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.213883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.214513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.214794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.215071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.225444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.226844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:43.241167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:43.242336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:43.243441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:43.243441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:43.243441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:43.244083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 547/1091] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:43.248235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.335749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.346699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf084a-b371-4c06-b729-c2ca99648c53 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.381536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.382149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.382431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.382708 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.383355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:43.383662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.385097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.396711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 545/1092] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:43.402367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.433010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.437896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c2fc-a15d-415a-89d9-e87a4d6fccd1 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.472005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.472634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.472910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.473308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.480245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.484257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:54:43.489407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:43.492209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:54:43.493087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 548/1093] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:43.496458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.502951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088d954-a4c8-4622-a18e-73836c5416b6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.537674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.538304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.538580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.538848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.545977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.547458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:54:43.559645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:43.560765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:43.561739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 546/1094] 10.222.0.45 () {56 vars in 1093 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:43.567190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.593850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2bdc-7efc-407c-a9d3-9fbdf1aa50f9 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.627018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.627616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.627991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.628242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.628911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:43.629211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.630575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.639032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 549/1095] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:43.644745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.660851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.669219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b4b3-4bc6-4b1b-aecf-ffefe4700af6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.703882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.708196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.708812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.709088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.709353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.715094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:43.715094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.715094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.729821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 547/1096] 10.222.0.45 () {56 vars in 1133 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:43.735719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.745389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ae94a-f6cf-4cee-aafa-18b24e1a4afe None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.778200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.778820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.779094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.779367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] PATH_INFO: `/v3/users/37841c17b78a4018a1d1f1295e98f9b7` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.780503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] RBAC: Authorizing `identity:get_user(user_id=37841c17b78a4018a1d1f1295e98f9b7)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.781923 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.783486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 550/1097] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/users/37841c17b78a4018a1d1f1295e98f9b7 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:43.789837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:43.833026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41800de-a77a-48dc-9720-ddd3e53d6177 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.866371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.866972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.867243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.867517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.885708 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.887928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d97c86-8ab6-46cf-a831-e99f662a2326 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:43.914741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:43.922509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:43.923116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:43.923395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:43.923715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:43.934393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.935844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:43.991089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:43.992605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.032766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 548/1098] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 04:54:44.038632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:44.087533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:44.093453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 551/1099] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 04:54:44.099417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:44.126929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:44.139295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3d6b5-a74c-4e54-8b70-8a99efa1f633 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:44.173506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:44.174139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:44.174518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:44.175337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:44.185919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:44.187460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.197425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c3e1d-e1cf-4c45-b60c-60ba10a89b09 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:54:44.201366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:44.202466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:54:44.203448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:54:44.203448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:54:44.203448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:44.204049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 549/1100] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:44.209066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:44.233225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:44.234055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:44.234329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:44.234598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:44.235695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ac17919dafab40399fffd0227b4218e6)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:44.237160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.238766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 552/1101] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:54:44 2022] GET /identity/v3/projects/ac17919dafab40399fffd0227b4218e6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:44.245058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:44.309743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efe594-aadf-4f10-abd0-df5a977e95ef None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:44.311264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:44.336313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:44.342156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1a6e3-727a-4046-969e-381483e0b3c9 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:44.345571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:44.346177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:44.346455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:44.347296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:44.347999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:44.351812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:44.351812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.361310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 550/1102] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:44.366938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:44.378756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:44.379354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:44.379633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:44.379924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:44.380653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=ac17919dafab40399fffd0227b4218e6, user.id=37841c17b78a4018a1d1f1295e98f9b7) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:44.380961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:44.382389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.388071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 553/1103] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:44 2022] GET /identity/v3/role_assignments?user.id=37841c17b78a4018a1d1f1295e98f9b7&scope.project.id=ac17919dafab40399fffd0227b4218e6&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:44.476871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc5ea8-dde4-4a79-8153-9129f8f03064 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:44.513095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:44.513633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:44.513910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:44.514183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:44.522527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:44.524199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:54:44.535753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:54:44.536738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:54:44.537648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 551/1104] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:54:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:54:44.542902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:44.643111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2296b53-53d5-435a-a7b9-30548612190a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:44.677007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae842dc-370c-42ef-a5c0-1cd05ffc80c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:44.677610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae842dc-370c-42ef-a5c0-1cd05ffc80c5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:44.677884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae842dc-370c-42ef-a5c0-1cd05ffc80c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:44.678153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae842dc-370c-42ef-a5c0-1cd05ffc80c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:44.678840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae842dc-370c-42ef-a5c0-1cd05ffc80c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:44.679140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae842dc-370c-42ef-a5c0-1cd05ffc80c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:44.680701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae842dc-370c-42ef-a5c0-1cd05ffc80c5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.693048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 554/1105] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:54:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:44.699037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:44.724586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:44.799615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213220eb-e6d7-4c38-9968-5dbf95b81785 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:44.834521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e654f-d1ce-406d-9805-bc1e68c95648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:44.835123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e654f-d1ce-406d-9805-bc1e68c95648 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:44.835402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e654f-d1ce-406d-9805-bc1e68c95648 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:44.835673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e654f-d1ce-406d-9805-bc1e68c95648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:44.836430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e654f-d1ce-406d-9805-bc1e68c95648 None admin] RBAC: Adding query filter params (role.id=bf4489619afb44eda29600a33a606567, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=89cfa7e2f08741d4938a017990b8b031) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:44.836738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e654f-d1ce-406d-9805-bc1e68c95648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:44.838178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e654f-d1ce-406d-9805-bc1e68c95648 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:44.844073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 552/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:44 2022] GET /identity/v3/role_assignments?user.id=89cfa7e2f08741d4938a017990b8b031&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=bf4489619afb44eda29600a33a606567 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:46.326535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf914f-5e09-4f6d-8adc-410ee6fd14ec None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:46.327118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf914f-5e09-4f6d-8adc-410ee6fd14ec None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:46.327118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf914f-5e09-4f6d-8adc-410ee6fd14ec None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:46.328483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 555/1107] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:46.334380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d02017-4c14-4bb4-95de-99c2741bf427 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:46.334816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d02017-4c14-4bb4-95de-99c2741bf427 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:46.334914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d02017-4c14-4bb4-95de-99c2741bf427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:46.353467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-36d02017-4c14-4bb4-95de-99c2741bf427 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:46.354662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-36d02017-4c14-4bb4-95de-99c2741bf427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:46.419223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 553/1108] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:46.689226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf914f-5e09-4f6d-8adc-410ee6fd14ec None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:46.712659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:46.791433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf914f-5e09-4f6d-8adc-410ee6fd14ec None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:46.824856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b612f30-472a-43f4-a720-1727b0a5961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:46.825466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612f30-472a-43f4-a720-1727b0a5961b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:46.825746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612f30-472a-43f4-a720-1727b0a5961b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:46.826015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b612f30-472a-43f4-a720-1727b0a5961b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:46.827124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b612f30-472a-43f4-a720-1727b0a5961b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:46.828593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b612f30-472a-43f4-a720-1727b0a5961b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:46.830159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 556/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:46.836439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d02017-4c14-4bb4-95de-99c2741bf427 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:46.854082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:46.932710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d02017-4c14-4bb4-95de-99c2741bf427 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:46.966155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7aa44f-24eb-4021-9896-16d9d75a21fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:46.966701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa44f-24eb-4021-9896-16d9d75a21fc None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:46.966980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa44f-24eb-4021-9896-16d9d75a21fc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:46.967250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7aa44f-24eb-4021-9896-16d9d75a21fc None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:46.967952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aa44f-24eb-4021-9896-16d9d75a21fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:46.969370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7aa44f-24eb-4021-9896-16d9d75a21fc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:47.069391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 554/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:54:46 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:54:49.074206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b39c1-05dc-430f-9054-de4d62827bf1 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:49.074756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b39c1-05dc-430f-9054-de4d62827bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:49.074756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b39c1-05dc-430f-9054-de4d62827bf1 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:49.076169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 557/1111] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:49.081420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046a3b-3b49-436a-a662-761025bb87e7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:49.081799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046a3b-3b49-436a-a662-761025bb87e7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:49.082041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f046a3b-3b49-436a-a662-761025bb87e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:49.100403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-1f046a3b-3b49-436a-a662-761025bb87e7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:49.101591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1f046a3b-3b49-436a-a662-761025bb87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:49.166380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 555/1112] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:49.436094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b39c1-05dc-430f-9054-de4d62827bf1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:49.521638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:49.533793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b39c1-05dc-430f-9054-de4d62827bf1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:49.567440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:49.568082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:49.568357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:49.568627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] PATH_INFO: `/v3/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:49.570001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] RBAC: Authorizing `identity:get_role(role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:49.571362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:49.572728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 558/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:49 2022] GET /identity/v3/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:49.578546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046a3b-3b49-436a-a662-761025bb87e7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:49.584619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:49.679074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f046a3b-3b49-436a-a662-761025bb87e7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:49.712882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f9abd-5977-490c-964e-052e56705856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:49.713514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9abd-5977-490c-964e-052e56705856 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:49.713790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9abd-5977-490c-964e-052e56705856 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:49.714059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9abd-5977-490c-964e-052e56705856 None admin] PATH_INFO: `/v3/users/df6c767e5f464465be8b7d00b1c5f081` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:49.728041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f9abd-5977-490c-964e-052e56705856 None admin] RBAC: Authorizing `identity:get_user(user_id=df6c767e5f464465be8b7d00b1c5f081)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:49.729566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f9abd-5977-490c-964e-052e56705856 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:49.731168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 556/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:49 2022] GET /identity/v3/users/df6c767e5f464465be8b7d00b1c5f081 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:49.736914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:49.835133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689320cd-acc0-4a93-bb3c-88d37759e075 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:49.868830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:49.869420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:49.869696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:49.869971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:49.893265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:49.935509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:49.937000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:50.039434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 559/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:54:50.045599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f9abd-5977-490c-964e-052e56705856 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:50.102839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:50.142075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f9abd-5977-490c-964e-052e56705856 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:50.174317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcecbdd-2d2a-4afb-b834-610d3fbe6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:50.175715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecbdd-2d2a-4afb-b834-610d3fbe6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:50.176023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecbdd-2d2a-4afb-b834-610d3fbe6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:50.176299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcecbdd-2d2a-4afb-b834-610d3fbe6fb7 None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:50.177398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcecbdd-2d2a-4afb-b834-610d3fbe6fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=ac17919dafab40399fffd0227b4218e6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:50.178824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcecbdd-2d2a-4afb-b834-610d3fbe6fb7 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:50.180443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 557/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:54:50 2022] GET /identity/v3/projects/ac17919dafab40399fffd0227b4218e6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:54:50.186535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:50.241276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:50.284068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead856-a9ca-4186-abaf-63e670a57281 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:50.317863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd0de2-211b-43a8-ad82-24ee7fc593d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:50.318400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0de2-211b-43a8-ad82-24ee7fc593d3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:50.318678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0de2-211b-43a8-ad82-24ee7fc593d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:50.318952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd0de2-211b-43a8-ad82-24ee7fc593d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:50.319674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0de2-211b-43a8-ad82-24ee7fc593d3 None admin] RBAC: Adding query filter params (role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=ac17919dafab40399fffd0227b4218e6, user.id=df6c767e5f464465be8b7d00b1c5f081) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:50.320013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0de2-211b-43a8-ad82-24ee7fc593d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:50.321462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd0de2-211b-43a8-ad82-24ee7fc593d3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:50.326989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 560/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:50 2022] GET /identity/v3/role_assignments?user.id=df6c767e5f464465be8b7d00b1c5f081&scope.project.id=ac17919dafab40399fffd0227b4218e6&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:52.198375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212ffd-a59e-4989-9dc3-39b0e662391d None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:52.198953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212ffd-a59e-4989-9dc3-39b0e662391d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:52.198953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7212ffd-a59e-4989-9dc3-39b0e662391d None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:52.200437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 558/1118] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:52.205538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cafb-5d24-404c-b641-36bc57c99321 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:52.205974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cafb-5d24-404c-b641-36bc57c99321 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:52.206124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca9cafb-5d24-404c-b641-36bc57c99321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:52.224640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-bca9cafb-5d24-404c-b641-36bc57c99321 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:52.226081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bca9cafb-5d24-404c-b641-36bc57c99321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:52.291153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 561/1119] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:52.558747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212ffd-a59e-4989-9dc3-39b0e662391d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:52.657936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7212ffd-a59e-4989-9dc3-39b0e662391d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:52.684209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:52.691752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:52.692402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:52.692680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:52.692952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] PATH_INFO: `/v3/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:52.694339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] RBAC: Authorizing `identity:get_role(role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:52.695713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:52.697072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 559/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:52 2022] GET /identity/v3/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:52.702766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9cafb-5d24-404c-b641-36bc57c99321 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:52.753546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:52.802501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca9cafb-5d24-404c-b641-36bc57c99321 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:52.834858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:52.835427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:52.835705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:52.836004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] PATH_INFO: `/v3/users/df6c767e5f464465be8b7d00b1c5f081` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:52.837118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] RBAC: Authorizing `identity:get_user(user_id=df6c767e5f464465be8b7d00b1c5f081)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:52.838561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:52.840181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 562/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:52 2022] GET /identity/v3/users/df6c767e5f464465be8b7d00b1c5f081 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:52.845988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:52.947509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ea2a9-2f19-4531-86e1-59facfe4a001 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:52.983697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2041b5-a7f7-4ca1-ad74-ab8ba30c1447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:52.984355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2041b5-a7f7-4ca1-ad74-ab8ba30c1447 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:52.984636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2041b5-a7f7-4ca1-ad74-ab8ba30c1447 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:52.984910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2041b5-a7f7-4ca1-ad74-ab8ba30c1447 None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:52.986036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2041b5-a7f7-4ca1-ad74-ab8ba30c1447 None admin] RBAC: Authorizing `identity:get_project(project_id=ac17919dafab40399fffd0227b4218e6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:52.988139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2041b5-a7f7-4ca1-ad74-ab8ba30c1447 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:52.989776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 560/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:54:52 2022] GET /identity/v3/projects/ac17919dafab40399fffd0227b4218e6 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:52.995725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:53.093370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b9623-1a8d-4c3f-848e-9a26c005b4f3 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:53.111570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:53.127475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801214f-4bd4-4305-9745-fd0c63558fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:53.128177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801214f-4bd4-4305-9745-fd0c63558fa8 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:53.128453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801214f-4bd4-4305-9745-fd0c63558fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:53.128725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801214f-4bd4-4305-9745-fd0c63558fa8 None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6/users/df6c767e5f464465be8b7d00b1c5f081/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:53.130886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801214f-4bd4-4305-9745-fd0c63558fa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac17919dafab40399fffd0227b4218e6, user_id=df6c767e5f464465be8b7d00b1c5f081, role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:53.132354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801214f-4bd4-4305-9745-fd0c63558fa8 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:53.193654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 563/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:54:52 2022] PUT /identity/v3/projects/ac17919dafab40399fffd0227b4218e6/users/df6c767e5f464465be8b7d00b1c5f081/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:54:55.061710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeed85-d6c8-4b90-ad5e-485f00578f8f None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:55.062234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeed85-d6c8-4b90-ad5e-485f00578f8f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:55.062234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeed85-d6c8-4b90-ad5e-485f00578f8f None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:55.063898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 561/1124] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:55.069885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d658-3fb8-492f-b4ae-f57c02bdc2d3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:55.070303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d658-3fb8-492f-b4ae-f57c02bdc2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:55.070411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d658-3fb8-492f-b4ae-f57c02bdc2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:55.088576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-72a1d658-3fb8-492f-b4ae-f57c02bdc2d3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:55.089754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-72a1d658-3fb8-492f-b4ae-f57c02bdc2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:55.154865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 564/1125] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:55.420767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeed85-d6c8-4b90-ad5e-485f00578f8f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:55.482508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:55.520459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeed85-d6c8-4b90-ad5e-485f00578f8f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:55.553234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:55.553858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:55.554139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:55.554415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] PATH_INFO: `/v3/roles/08ce6d1d948f4184b6e40c1ab02eeadd` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:55.555810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] RBAC: Authorizing `identity:get_role(role_id=08ce6d1d948f4184b6e40c1ab02eeadd)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:55.557227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:55.558540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 562/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:55 2022] GET /identity/v3/roles/08ce6d1d948f4184b6e40c1ab02eeadd => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:55.564538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d658-3fb8-492f-b4ae-f57c02bdc2d3 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:55.662571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d658-3fb8-492f-b4ae-f57c02bdc2d3 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:55.671465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:55.695780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:55.696433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:55.696711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:55.696981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] PATH_INFO: `/v3/users/df6c767e5f464465be8b7d00b1c5f081` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:55.698102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] RBAC: Authorizing `identity:get_user(user_id=df6c767e5f464465be8b7d00b1c5f081)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:55.699535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:55.701327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 565/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:54:55 2022] GET /identity/v3/users/df6c767e5f464465be8b7d00b1c5f081 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:55.707337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:55.806051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e82a02-cb9d-4b05-ba1d-7e2a05ff0c92 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:55.834010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:55.838712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:55.839302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:55.839580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:55.839846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:55.904057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:55.905499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:56.000354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 563/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:54:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:54:56.006417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:56.104400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8167f-83b4-4eb8-b27c-9174d4603f95 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:56.137276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a17d38-f821-44dc-ba10-55d4465ab7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:56.137893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17d38-f821-44dc-ba10-55d4465ab7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:56.138172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17d38-f821-44dc-ba10-55d4465ab7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:56.138447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a17d38-f821-44dc-ba10-55d4465ab7e1 None admin] PATH_INFO: `/v3/projects/ac17919dafab40399fffd0227b4218e6` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:56.139565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a17d38-f821-44dc-ba10-55d4465ab7e1 None admin] RBAC: Authorizing `identity:get_project(project_id=ac17919dafab40399fffd0227b4218e6)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:56.141042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a17d38-f821-44dc-ba10-55d4465ab7e1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:56.142671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 566/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:54:56 2022] GET /identity/v3/projects/ac17919dafab40399fffd0227b4218e6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:56.149253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:56.178944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:56.246739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c63ba-f055-4276-8895-ad622d020fd8 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:56.279842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8bf221-0c05-4fbb-a3ba-c9264d0ab4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:56.280410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bf221-0c05-4fbb-a3ba-c9264d0ab4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:56.280690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bf221-0c05-4fbb-a3ba-c9264d0ab4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:56.280961 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8bf221-0c05-4fbb-a3ba-c9264d0ab4a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:56.281678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bf221-0c05-4fbb-a3ba-c9264d0ab4a1 None admin] RBAC: Adding query filter params (role.id=08ce6d1d948f4184b6e40c1ab02eeadd, scope.project.id=ac17919dafab40399fffd0227b4218e6, user.id=df6c767e5f464465be8b7d00b1c5f081) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:54:56.281988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bf221-0c05-4fbb-a3ba-c9264d0ab4a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:56.283411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8bf221-0c05-4fbb-a3ba-c9264d0ab4a1 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:56.289123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 564/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:54:56 2022] GET /identity/v3/role_assignments?user.id=df6c767e5f464465be8b7d00b1c5f081&scope.project.id=ac17919dafab40399fffd0227b4218e6&role.id=08ce6d1d948f4184b6e40c1ab02eeadd => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:58.182402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b70ae-538d-4afc-98fa-19ccda096593 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:58.182956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b70ae-538d-4afc-98fa-19ccda096593 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:58.182956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b70ae-538d-4afc-98fa-19ccda096593 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:58.184321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 567/1131] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:54:58.189479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76538261-8f84-4c1f-a146-e09cdcfd8aa8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:58.190379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76538261-8f84-4c1f-a146-e09cdcfd8aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:58.190518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76538261-8f84-4c1f-a146-e09cdcfd8aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:58.209007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-76538261-8f84-4c1f-a146-e09cdcfd8aa8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:54:58.210181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-76538261-8f84-4c1f-a146-e09cdcfd8aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:54:58.285269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 565/1132] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:54:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:54:58.556040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b70ae-538d-4afc-98fa-19ccda096593 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:58.605952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:58.663043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b70ae-538d-4afc-98fa-19ccda096593 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:58.696289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779047fa-2ce1-4f1c-82f4-e8c569f7f7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:58.696915 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779047fa-2ce1-4f1c-82f4-e8c569f7f7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:58.697193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779047fa-2ce1-4f1c-82f4-e8c569f7f7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:58.697467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779047fa-2ce1-4f1c-82f4-e8c569f7f7f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:58.698579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779047fa-2ce1-4f1c-82f4-e8c569f7f7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:58.700058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779047fa-2ce1-4f1c-82f4-e8c569f7f7f1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:58.701645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 568/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:54:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:54:58.707853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76538261-8f84-4c1f-a146-e09cdcfd8aa8 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:54:58.734628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:54:58.803726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76538261-8f84-4c1f-a146-e09cdcfd8aa8 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:54:58.836170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4917d22-89ba-4ae7-b6b9-14d36330f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:54:58.836705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917d22-89ba-4ae7-b6b9-14d36330f326 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:54:58.836979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917d22-89ba-4ae7-b6b9-14d36330f326 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:54:58.837249 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917d22-89ba-4ae7-b6b9-14d36330f326 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:54:58.837880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4917d22-89ba-4ae7-b6b9-14d36330f326 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:54:58.839314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4917d22-89ba-4ae7-b6b9-14d36330f326 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:54:58.934703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 566/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:54:58 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:55:00.854300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2e246-cf84-46e9-a005-5e93cba8fa5c None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:00.854822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2e246-cf84-46e9-a005-5e93cba8fa5c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:00.854822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2e246-cf84-46e9-a005-5e93cba8fa5c None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:00.856240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 569/1135] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:00.861359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee5cf-6207-4f2a-aafd-2c201d24270f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:00.861730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee5cf-6207-4f2a-aafd-2c201d24270f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:00.862145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ee5cf-6207-4f2a-aafd-2c201d24270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:00.880343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c21ee5cf-6207-4f2a-aafd-2c201d24270f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:00.881524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c21ee5cf-6207-4f2a-aafd-2c201d24270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:00.954108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 567/1136] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:01.231726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2e246-cf84-46e9-a005-5e93cba8fa5c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:01.332734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2e246-cf84-46e9-a005-5e93cba8fa5c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:01.345184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:01.365662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdc710-2c33-445c-9328-292bdeb1fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:01.367601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdc710-2c33-445c-9328-292bdeb1fa3a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:01.367601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdc710-2c33-445c-9328-292bdeb1fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:01.367601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdc710-2c33-445c-9328-292bdeb1fa3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:01.368053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdc710-2c33-445c-9328-292bdeb1fa3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:01.369484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdc710-2c33-445c-9328-292bdeb1fa3a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:01.371046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 570/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:55:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:01.377039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee5cf-6207-4f2a-aafd-2c201d24270f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:01.387586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:01.473584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ee5cf-6207-4f2a-aafd-2c201d24270f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:01.507237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82db76-4ea6-4ff0-b59a-eaf211a2c0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:01.507836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82db76-4ea6-4ff0-b59a-eaf211a2c0fa None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:01.508148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82db76-4ea6-4ff0-b59a-eaf211a2c0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:01.508418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82db76-4ea6-4ff0-b59a-eaf211a2c0fa None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:01.509067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82db76-4ea6-4ff0-b59a-eaf211a2c0fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:01.510533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82db76-4ea6-4ff0-b59a-eaf211a2c0fa None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:01.620971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 568/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:55:01 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:55:03.550242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b9b5-930f-43eb-ad5d-1468acadc54c None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:03.550805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b9b5-930f-43eb-ad5d-1468acadc54c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:03.550805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b9b5-930f-43eb-ad5d-1468acadc54c None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:03.552156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 571/1139] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:03.557340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25bcb0-ebf2-4ae4-aeb2-98c49569e4b7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:03.557732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25bcb0-ebf2-4ae4-aeb2-98c49569e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:03.557880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25bcb0-ebf2-4ae4-aeb2-98c49569e4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:03.575441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ca25bcb0-ebf2-4ae4-aeb2-98c49569e4b7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:03.576663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ca25bcb0-ebf2-4ae4-aeb2-98c49569e4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:03.633692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:03.641590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 569/1140] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:03.913003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b9b5-930f-43eb-ad5d-1468acadc54c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:04.012679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b9b5-930f-43eb-ad5d-1468acadc54c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:04.049383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:04.050003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:04.050278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:04.050542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:04.060329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:55:04.065419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:55:04.066599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:55:04.067887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 572/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:55:04.072608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25bcb0-ebf2-4ae4-aeb2-98c49569e4b7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:04.168288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25bcb0-ebf2-4ae4-aeb2-98c49569e4b7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:04.200915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:04.201512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:04.201790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:04.202062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:04.202720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:04.203022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:04.204427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:04.212777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 570/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:55:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:04.218456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:04.260181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:04.317822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807eb3b-b56d-42d3-8ebf-903721dbf89d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:04.351354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:04.352004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:04.352287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:04.352569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] PATH_INFO: `/v3/users/cb2158231f5440418f577ab840c9c8fb` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:04.366084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2158231f5440418f577ab840c9c8fb)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:04.367540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:04.369198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 573/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:55:04 2022] GET /identity/v3/users/cb2158231f5440418f577ab840c9c8fb => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:04.375117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:04.430186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:04.512726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc5e5-db51-4798-96bb-ceab441a67b4 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:04.544621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:04.545212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:04.545491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:04.545764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:04.610976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:04.612989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:04.665850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:04.708930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 571/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:55:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:55:04.714818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:04.809729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:04.813482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cc2ec-1da2-4d3e-9ea2-47871119df24 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:04.845713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572dd24c-a1c7-4483-a410-4f90316a76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:04.846900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd24c-a1c7-4483-a410-4f90316a76ea None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:04.847349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd24c-a1c7-4483-a410-4f90316a76ea None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:04.847483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dd24c-a1c7-4483-a410-4f90316a76ea None admin] PATH_INFO: `/v3/projects/df5189e751aa407b9f8a7c72578a2bd6` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:04.848698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dd24c-a1c7-4483-a410-4f90316a76ea None admin] RBAC: Authorizing `identity:get_project(project_id=df5189e751aa407b9f8a7c72578a2bd6)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:04.850413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572dd24c-a1c7-4483-a410-4f90316a76ea None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:04.852067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 574/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:55:04 2022] GET /identity/v3/projects/df5189e751aa407b9f8a7c72578a2bd6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:04.858172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:04.954265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18121f7f-e955-498b-a5d5-cebbca01b238 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:04.988498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1569b-d0ea-46e1-a513-9ab12668bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:04.989093 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1569b-d0ea-46e1-a513-9ab12668bb06 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:04.989371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1569b-d0ea-46e1-a513-9ab12668bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:04.989642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1569b-d0ea-46e1-a513-9ab12668bb06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:04.990362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1569b-d0ea-46e1-a513-9ab12668bb06 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=df5189e751aa407b9f8a7c72578a2bd6, user.id=cb2158231f5440418f577ab840c9c8fb) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:04.990670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1569b-d0ea-46e1-a513-9ab12668bb06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:04.992126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1569b-d0ea-46e1-a513-9ab12668bb06 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:04.997354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 572/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:55:04 2022] GET /identity/v3/role_assignments?user.id=cb2158231f5440418f577ab840c9c8fb&scope.project.id=df5189e751aa407b9f8a7c72578a2bd6&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:06.913863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebbcf5-4186-4a6e-ae03-b72d08d08345 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:06.914376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebbcf5-4186-4a6e-ae03-b72d08d08345 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:06.914467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebbcf5-4186-4a6e-ae03-b72d08d08345 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:06.915764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 575/1147] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:06.921178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fcd54-d1b4-4f55-8a15-59aaf91a35ed None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:06.921606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fcd54-d1b4-4f55-8a15-59aaf91a35ed None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:06.921724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fcd54-d1b4-4f55-8a15-59aaf91a35ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:06.940152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-996fcd54-d1b4-4f55-8a15-59aaf91a35ed None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:06.941341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-996fcd54-d1b4-4f55-8a15-59aaf91a35ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:06.954938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:07.010928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 573/1148] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:55:07.290576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebbcf5-4186-4a6e-ae03-b72d08d08345 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:07.389848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebbcf5-4186-4a6e-ae03-b72d08d08345 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:07.423025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818706a-6a70-424c-9228-81637c059ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:07.423635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818706a-6a70-424c-9228-81637c059ace None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:07.423957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818706a-6a70-424c-9228-81637c059ace None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:07.424234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818706a-6a70-424c-9228-81637c059ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:07.434051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818706a-6a70-424c-9228-81637c059ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e818706a-6a70-424c-9228-81637c059ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:55:07.438674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:55:07.439842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:55:07.440892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 576/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:55:07.445680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fcd54-d1b4-4f55-8a15-59aaf91a35ed None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:07.541632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fcd54-d1b4-4f55-8a15-59aaf91a35ed None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:07.573421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:07.574010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:07.574284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:07.574551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:07.575200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:07.575496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:07.576887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:07.585211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 574/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:07.590908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818706a-6a70-424c-9228-81637c059ace None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:07.618687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:07.690332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818706a-6a70-424c-9228-81637c059ace None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:07.724403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:07.725019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:07.725546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:07.725812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] PATH_INFO: `/v3/users/cb2158231f5440418f577ab840c9c8fb` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:07.726913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] RBAC: Authorizing `identity:get_user(user_id=cb2158231f5440418f577ab840c9c8fb)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:07.728392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:07.729964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 577/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:55:07 2022] GET /identity/v3/users/cb2158231f5440418f577ab840c9c8fb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:07.735680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:07.750750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:07.832229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4697b-cf4c-4e39-9cd0-909102d325b6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:07.865007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129235e5-3c79-44f6-9a57-03c4cd36ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:07.865619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129235e5-3c79-44f6-9a57-03c4cd36ca79 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:07.865894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129235e5-3c79-44f6-9a57-03c4cd36ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:07.866162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129235e5-3c79-44f6-9a57-03c4cd36ca79 None admin] PATH_INFO: `/v3/projects/df5189e751aa407b9f8a7c72578a2bd6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:07.867255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129235e5-3c79-44f6-9a57-03c4cd36ca79 None admin] RBAC: Authorizing `identity:get_project(project_id=df5189e751aa407b9f8a7c72578a2bd6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:07.868713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129235e5-3c79-44f6-9a57-03c4cd36ca79 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:07.870300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 575/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:55:07 2022] GET /identity/v3/projects/df5189e751aa407b9f8a7c72578a2bd6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:07.876233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:07.966623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:07.973064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664bf204-e546-4b67-9ab5-98df9ffbb485 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:08.006616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d5e10-2bdb-412b-a4d8-738a923466fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:08.007254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5e10-2bdb-412b-a4d8-738a923466fc None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:08.007527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5e10-2bdb-412b-a4d8-738a923466fc None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:08.007794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d5e10-2bdb-412b-a4d8-738a923466fc None admin] PATH_INFO: `/v3/projects/df5189e751aa407b9f8a7c72578a2bd6/users/cb2158231f5440418f577ab840c9c8fb/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:08.009690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5e10-2bdb-412b-a4d8-738a923466fc None admin] RBAC: Authorizing `identity:create_grant(project_id=df5189e751aa407b9f8a7c72578a2bd6, user_id=cb2158231f5440418f577ab840c9c8fb, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:08.011111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d5e10-2bdb-412b-a4d8-738a923466fc None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:08.090941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 578/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:55:07 2022] PUT /identity/v3/projects/df5189e751aa407b9f8a7c72578a2bd6/users/cb2158231f5440418f577ab840c9c8fb/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:55:09.973586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93bdc9-d7fb-4da3-82ed-adc7ed19889e None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:09.974078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93bdc9-d7fb-4da3-82ed-adc7ed19889e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:09.974078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93bdc9-d7fb-4da3-82ed-adc7ed19889e None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:09.975662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 576/1154] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:09.980774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7037e6-dec0-46dd-9218-5b8f79d15a25 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:09.981175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7037e6-dec0-46dd-9218-5b8f79d15a25 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:09.981317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7037e6-dec0-46dd-9218-5b8f79d15a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:09.999360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-4d7037e6-dec0-46dd-9218-5b8f79d15a25 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:10.000572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4d7037e6-dec0-46dd-9218-5b8f79d15a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:10.065749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 579/1155] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:10.331728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93bdc9-d7fb-4da3-82ed-adc7ed19889e None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:10.411717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:10.430894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93bdc9-d7fb-4da3-82ed-adc7ed19889e None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:10.464798 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:10.465416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:10.465690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:10.465959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:10.476615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:55:10.481201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:55:10.482294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:55:10.483348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 577/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:55:10.488244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7037e6-dec0-46dd-9218-5b8f79d15a25 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:10.568192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:10.583455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7037e6-dec0-46dd-9218-5b8f79d15a25 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:10.616311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:10.616896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:10.617171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:10.617442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:10.618095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:10.618395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:10.619754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:10.628001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 580/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:10.633716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:10.740346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32be414-6513-41dc-a12d-df0d6ed34e24 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:10.775169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:10.775791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:10.776105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:10.776382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] PATH_INFO: `/v3/users/cb2158231f5440418f577ab840c9c8fb` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:10.777519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] RBAC: Authorizing `identity:get_user(user_id=cb2158231f5440418f577ab840c9c8fb)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:10.778961 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:10.780575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 578/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:55:10 2022] GET /identity/v3/users/cb2158231f5440418f577ab840c9c8fb => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:10.786655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:10.883665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac57db-46b0-4434-9687-730b6383d577 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:10.916630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:10.917228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:10.917506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:10.917777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:10.932405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:10.983448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:10.984918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:11.090964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 581/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:55:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:55:11.097641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:11.108465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:11.198922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f3ae-d8ad-4833-b242-63fa188c621c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:11.232220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fee27-6d50-4a87-9e87-a2d319e8a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:11.232983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fee27-6d50-4a87-9e87-a2d319e8a786 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:11.233264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fee27-6d50-4a87-9e87-a2d319e8a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:11.233535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fee27-6d50-4a87-9e87-a2d319e8a786 None admin] PATH_INFO: `/v3/projects/df5189e751aa407b9f8a7c72578a2bd6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:11.234644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fee27-6d50-4a87-9e87-a2d319e8a786 None admin] RBAC: Authorizing `identity:get_project(project_id=df5189e751aa407b9f8a7c72578a2bd6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:11.236123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fee27-6d50-4a87-9e87-a2d319e8a786 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:11.237751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 579/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:55:11 2022] GET /identity/v3/projects/df5189e751aa407b9f8a7c72578a2bd6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:11.243953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:11.289399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:11.341843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0680-db31-414a-a04e-a8d11e07fbb5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:11.375379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6051f6-cdcc-45da-b11d-b5a280184c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:11.375995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6051f6-cdcc-45da-b11d-b5a280184c68 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:11.376274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6051f6-cdcc-45da-b11d-b5a280184c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:11.376541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6051f6-cdcc-45da-b11d-b5a280184c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:11.378040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6051f6-cdcc-45da-b11d-b5a280184c68 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=df5189e751aa407b9f8a7c72578a2bd6, user.id=cb2158231f5440418f577ab840c9c8fb) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:11.378353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6051f6-cdcc-45da-b11d-b5a280184c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:11.379784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6051f6-cdcc-45da-b11d-b5a280184c68 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:11.385376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 582/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:55:11 2022] GET /identity/v3/role_assignments?user.id=cb2158231f5440418f577ab840c9c8fb&scope.project.id=df5189e751aa407b9f8a7c72578a2bd6&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:13.292159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bf91a-1b9d-4a8f-b39b-966164281706 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:13.292687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bf91a-1b9d-4a8f-b39b-966164281706 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:13.292687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bf91a-1b9d-4a8f-b39b-966164281706 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:13.294137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 580/1162] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:13.299901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c66ed-abce-4511-a295-5a90d09a432f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:13.300341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c66ed-abce-4511-a295-5a90d09a432f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:13.300478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c66ed-abce-4511-a295-5a90d09a432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:13.319633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-c27c66ed-abce-4511-a295-5a90d09a432f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:13.320855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c27c66ed-abce-4511-a295-5a90d09a432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:13.390749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 583/1163] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:13.663168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bf91a-1b9d-4a8f-b39b-966164281706 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:13.739804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:13.762188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bf91a-1b9d-4a8f-b39b-966164281706 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:13.795152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:13.795742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:13.796041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:13.796309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:13.862311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:13.863767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:13.935260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:13.957278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 581/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:55:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:55:13.963225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c66ed-abce-4511-a295-5a90d09a432f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:14.011495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:14.067223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c66ed-abce-4511-a295-5a90d09a432f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:14.100818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213acd94-74a4-409e-8bff-72febdd62e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:14.101439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213acd94-74a4-409e-8bff-72febdd62e87 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:14.101720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213acd94-74a4-409e-8bff-72febdd62e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:14.101990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213acd94-74a4-409e-8bff-72febdd62e87 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:14.108550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213acd94-74a4-409e-8bff-72febdd62e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:14.109989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213acd94-74a4-409e-8bff-72febdd62e87 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-213acd94-74a4-409e-8bff-72febdd62e87 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:55:14.120916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:55:14.122146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:55:14.123030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 584/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:55:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:55:14.128123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:14.224749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fda7f-d5b9-4112-8c49-834e390bd249 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:14.257594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9175a4-2e31-4ce6-b818-7f754695d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:14.258189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9175a4-2e31-4ce6-b818-7f754695d29f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:14.258469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9175a4-2e31-4ce6-b818-7f754695d29f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:14.258742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9175a4-2e31-4ce6-b818-7f754695d29f None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:14.259380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9175a4-2e31-4ce6-b818-7f754695d29f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:14.259684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9175a4-2e31-4ce6-b818-7f754695d29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:14.261086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9175a4-2e31-4ce6-b818-7f754695d29f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:14.268527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 582/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Thu Aug 25 04:55:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:16.133954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8072-7c0b-4dca-b4d5-e4887a26fc74 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:16.134582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8072-7c0b-4dca-b4d5-e4887a26fc74 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:16.134582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8072-7c0b-4dca-b4d5-e4887a26fc74 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:16.135833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 585/1167] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:16.141087 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95492396-3d8c-4d02-9af0-1f2487ff91e8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:16.141476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95492396-3d8c-4d02-9af0-1f2487ff91e8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:16.141633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95492396-3d8c-4d02-9af0-1f2487ff91e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:16.159963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-95492396-3d8c-4d02-9af0-1f2487ff91e8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:16.161129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-95492396-3d8c-4d02-9af0-1f2487ff91e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:16.194073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:16.226280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 583/1168] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:16.496043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8072-7c0b-4dca-b4d5-e4887a26fc74 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:16.592482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:16.597036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8072-7c0b-4dca-b4d5-e4887a26fc74 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:16.630760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feb609-2158-432c-84b3-6762d5f65d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:16.631356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb609-2158-432c-84b3-6762d5f65d4a None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:16.631636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb609-2158-432c-84b3-6762d5f65d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:16.631933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb609-2158-432c-84b3-6762d5f65d4a None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:16.632693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feb609-2158-432c-84b3-6762d5f65d4a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:16.634538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feb609-2158-432c-84b3-6762d5f65d4a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:16.756033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 586/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Thu Aug 25 04:55:16 2022] POST /identity/v3/domains => generated 267 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:55:18.686278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6ccd-72ad-40c2-ae81-d28950d1a453 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:18.686815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6ccd-72ad-40c2-ae81-d28950d1a453 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:18.686815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6ccd-72ad-40c2-ae81-d28950d1a453 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:18.688198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 584/1170] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:18.693507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759c8f-ccc5-40dd-88fe-0c1a71276b0c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:18.693922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759c8f-ccc5-40dd-88fe-0c1a71276b0c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:18.694052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759c8f-ccc5-40dd-88fe-0c1a71276b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:18.718638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-45759c8f-ccc5-40dd-88fe-0c1a71276b0c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:18.719834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-45759c8f-ccc5-40dd-88fe-0c1a71276b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:18.799399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 587/1171] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:19.076913 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba6ccd-72ad-40c2-ae81-d28950d1a453 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:19.183597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba6ccd-72ad-40c2-ae81-d28950d1a453 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:19.216094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224107d1-5413-4983-85ba-edf045b388c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:19.216711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224107d1-5413-4983-85ba-edf045b388c4 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:19.216986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224107d1-5413-4983-85ba-edf045b388c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:19.217254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224107d1-5413-4983-85ba-edf045b388c4 None admin] PATH_INFO: `/v3/domains/6deebabaa96446088ed15c6cb3a07204` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:19.228436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224107d1-5413-4983-85ba-edf045b388c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6deebabaa96446088ed15c6cb3a07204)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:19.229890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224107d1-5413-4983-85ba-edf045b388c4 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:19.231459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 585/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Aug 25 04:55:19 2022] GET /identity/v3/domains/6deebabaa96446088ed15c6cb3a07204 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:19.238430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759c8f-ccc5-40dd-88fe-0c1a71276b0c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:19.323980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:19.333549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759c8f-ccc5-40dd-88fe-0c1a71276b0c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:19.366231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1f097-3643-4f85-9f10-c3781b5856bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:19.366822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1f097-3643-4f85-9f10-c3781b5856bd None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:19.367097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1f097-3643-4f85-9f10-c3781b5856bd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:19.367366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1f097-3643-4f85-9f10-c3781b5856bd None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:19.368035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1f097-3643-4f85-9f10-c3781b5856bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:19.369453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1f097-3643-4f85-9f10-c3781b5856bd None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:19.463115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 588/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:55:19 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:55:21.511025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7b78f-e4c8-4e32-a80f-7bf757baaca8 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:21.511589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7b78f-e4c8-4e32-a80f-7bf757baaca8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:21.511589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7b78f-e4c8-4e32-a80f-7bf757baaca8 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:21.512946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 586/1174] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:21.518868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289bf4-fff3-4039-9fec-393e45fb02f0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:21.519255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289bf4-fff3-4039-9fec-393e45fb02f0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:21.519415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf289bf4-fff3-4039-9fec-393e45fb02f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:21.538543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-bf289bf4-fff3-4039-9fec-393e45fb02f0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:21.539720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bf289bf4-fff3-4039-9fec-393e45fb02f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:21.605190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 589/1175] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:21.883493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7b78f-e4c8-4e32-a80f-7bf757baaca8 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:21.913818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:21.983371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7b78f-e4c8-4e32-a80f-7bf757baaca8 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:22.016387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b78b-cede-483e-b73a-b97c0ca8190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:22.017001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b78b-cede-483e-b73a-b97c0ca8190b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:22.017319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b78b-cede-483e-b73a-b97c0ca8190b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:22.017588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b78b-cede-483e-b73a-b97c0ca8190b None admin] PATH_INFO: `/v3/domains/6deebabaa96446088ed15c6cb3a07204` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:22.018695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b78b-cede-483e-b73a-b97c0ca8190b None admin] RBAC: Authorizing `identity:get_domain(domain_id=6deebabaa96446088ed15c6cb3a07204)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:22.020154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b78b-cede-483e-b73a-b97c0ca8190b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:22.021698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 587/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Thu Aug 25 04:55:21 2022] GET /identity/v3/domains/6deebabaa96446088ed15c6cb3a07204 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:22.027474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289bf4-fff3-4039-9fec-393e45fb02f0 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:22.094953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:22.124713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf289bf4-fff3-4039-9fec-393e45fb02f0 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:22.158367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee5596-5f3e-4f83-8322-670d4648e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:22.158904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5596-5f3e-4f83-8322-670d4648e3f5 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:22.159178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5596-5f3e-4f83-8322-670d4648e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:22.159444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5596-5f3e-4f83-8322-670d4648e3f5 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:22.160099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee5596-5f3e-4f83-8322-670d4648e3f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:22.161523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee5596-5f3e-4f83-8322-670d4648e3f5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:22.227702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 590/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:55:22 2022] POST /identity/v3/users => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:55:24.147743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f264-9a79-44f3-beca-d3a82a9cabb2 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:24.148327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f264-9a79-44f3-beca-d3a82a9cabb2 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:24.148327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f264-9a79-44f3-beca-d3a82a9cabb2 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:24.149661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 588/1178] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:24.155008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae217-54a0-4749-b7bf-94756bc28e83 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:24.155434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae217-54a0-4749-b7bf-94756bc28e83 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:24.155530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae217-54a0-4749-b7bf-94756bc28e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:24.174581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b85ae217-54a0-4749-b7bf-94756bc28e83 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:24.175756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b85ae217-54a0-4749-b7bf-94756bc28e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:24.239877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 591/1179] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:24.508506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f264-9a79-44f3-beca-d3a82a9cabb2 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:24.602991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:24.607403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f264-9a79-44f3-beca-d3a82a9cabb2 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:24.640916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:24.641526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:24.641803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:24.642108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:24.651938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:55:24.656572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:55:24.657807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:55:24.658994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 589/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:55:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:55:24.663718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae217-54a0-4749-b7bf-94756bc28e83 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:24.719794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:24.760227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae217-54a0-4749-b7bf-94756bc28e83 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:24.792608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:24.793205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:24.793478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:24.793744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:24.794391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:24.794688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:24.796077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:24.804769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 592/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:55:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:55:24.810451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:24.907091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4eea0-8031-493c-b384-f3be8ff0b2fd None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:24.940968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:24.941855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:24.942121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] PATH_INFO: `/v3/users/6af9a1b328a6496eac22072514c0eae4` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:24.954813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] RBAC: Authorizing `identity:get_user(user_id=6af9a1b328a6496eac22072514c0eae4)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:24.956277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:24.957848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 590/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:55:24 2022] GET /identity/v3/users/6af9a1b328a6496eac22072514c0eae4 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:55:24.963613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:25.061359 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fad381-3c48-447e-858d-40e070fbbca7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:25.079872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:25.097929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:25.098531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:25.098806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:25.099075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:25.164170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:25.165614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:25.262060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 593/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:55:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:55:25.268913 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:25.287016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:25.365860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f16bf-63c0-4629-979d-e952386a96d3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:25.398159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea51925-a7bf-4c67-82e1-75b26bffc789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:25.398771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea51925-a7bf-4c67-82e1-75b26bffc789 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:25.399045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea51925-a7bf-4c67-82e1-75b26bffc789 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:25.399313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea51925-a7bf-4c67-82e1-75b26bffc789 None admin] PATH_INFO: `/v3/projects/706f68014ef848f6ab7710d48bb1632e` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:25.400429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea51925-a7bf-4c67-82e1-75b26bffc789 None admin] RBAC: Authorizing `identity:get_project(project_id=706f68014ef848f6ab7710d48bb1632e)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:25.401867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea51925-a7bf-4c67-82e1-75b26bffc789 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:25.403451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 591/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:55:25 2022] GET /identity/v3/projects/706f68014ef848f6ab7710d48bb1632e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:55:25.409986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:25.430343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:25.505363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b19ab-df4f-4aa6-b632-90fe8207a3b0 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:25.538603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd50ca-9502-4ed8-8f9a-0ebe06860527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:25.539191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd50ca-9502-4ed8-8f9a-0ebe06860527 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:25.539467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd50ca-9502-4ed8-8f9a-0ebe06860527 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:25.539736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd50ca-9502-4ed8-8f9a-0ebe06860527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:25.540483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd50ca-9502-4ed8-8f9a-0ebe06860527 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=706f68014ef848f6ab7710d48bb1632e, user.id=6af9a1b328a6496eac22072514c0eae4) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:25.540791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd50ca-9502-4ed8-8f9a-0ebe06860527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:25.542206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd50ca-9502-4ed8-8f9a-0ebe06860527 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:25.547398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 594/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:55:25 2022] GET /identity/v3/role_assignments?user.id=6af9a1b328a6496eac22072514c0eae4&scope.project.id=706f68014ef848f6ab7710d48bb1632e&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:55:27.422663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a2ac-efb3-46d8-844b-5a4d80548b4c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:27.423220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a2ac-efb3-46d8-844b-5a4d80548b4c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:27.423316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a2ac-efb3-46d8-844b-5a4d80548b4c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:27.424701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 592/1186] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:27.429746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af2a9-4391-48bb-81a8-3556cafbb9df None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:27.430164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af2a9-4391-48bb-81a8-3556cafbb9df None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:27.430295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af2a9-4391-48bb-81a8-3556cafbb9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:27.448643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2f2af2a9-4391-48bb-81a8-3556cafbb9df None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:27.449827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2f2af2a9-4391-48bb-81a8-3556cafbb9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:27.513939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 595/1187] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:27.784533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a2ac-efb3-46d8-844b-5a4d80548b4c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:27.866503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:27.881878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a2ac-efb3-46d8-844b-5a4d80548b4c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:27.914518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:27.915120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:27.915393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:27.915658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:27.926125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:55:27.930698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:55:27.931821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:55:27.932912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 593/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:55:27.937708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2af2a9-4391-48bb-81a8-3556cafbb9df None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:27.952268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:28.034146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2af2a9-4391-48bb-81a8-3556cafbb9df None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:28.067217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:28.067805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:28.068108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:28.068380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:28.069031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:28.069331 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:28.070738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:28.078501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 596/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:28.084267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:28.181330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee4706-7323-4157-8ca0-1d98239c1161 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:28.212759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:28.213366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:28.213639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:28.213908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] PATH_INFO: `/v3/users/6af9a1b328a6496eac22072514c0eae4` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:28.215007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] RBAC: Authorizing `identity:get_user(user_id=6af9a1b328a6496eac22072514c0eae4)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:28.216463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:28.217993 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 594/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:55:28 2022] GET /identity/v3/users/6af9a1b328a6496eac22072514c0eae4 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:28.224219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:28.299279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:28.320912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518eba5c-f194-402f-b238-ce2fed22ba3d None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:28.353864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7b662-6193-48b3-9350-492cc5201231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:28.354470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7b662-6193-48b3-9350-492cc5201231 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:28.354747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7b662-6193-48b3-9350-492cc5201231 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:28.355015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7b662-6193-48b3-9350-492cc5201231 None admin] PATH_INFO: `/v3/projects/706f68014ef848f6ab7710d48bb1632e` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:28.356125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7b662-6193-48b3-9350-492cc5201231 None admin] RBAC: Authorizing `identity:get_project(project_id=706f68014ef848f6ab7710d48bb1632e)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:28.357548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7b662-6193-48b3-9350-492cc5201231 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:28.359134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 597/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:55:28 2022] GET /identity/v3/projects/706f68014ef848f6ab7710d48bb1632e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:28.364979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:28.380028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:28.463057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7068102-8ae2-40ad-9aeb-577bec5ebeed None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:28.496683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88135f2f-d93f-44a9-a101-88a566bb5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:28.497325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88135f2f-d93f-44a9-a101-88a566bb5076 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:28.497601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88135f2f-d93f-44a9-a101-88a566bb5076 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:28.497873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88135f2f-d93f-44a9-a101-88a566bb5076 None admin] PATH_INFO: `/v3/projects/706f68014ef848f6ab7710d48bb1632e/users/6af9a1b328a6496eac22072514c0eae4/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:28.499757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88135f2f-d93f-44a9-a101-88a566bb5076 None admin] RBAC: Authorizing `identity:create_grant(project_id=706f68014ef848f6ab7710d48bb1632e, user_id=6af9a1b328a6496eac22072514c0eae4, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:28.501244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88135f2f-d93f-44a9-a101-88a566bb5076 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:28.569795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 595/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:55:28 2022] PUT /identity/v3/projects/706f68014ef848f6ab7710d48bb1632e/users/6af9a1b328a6496eac22072514c0eae4/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:55:30.437647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2961-b4f8-4877-ac45-b849f46e95f5 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:30.438197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2961-b4f8-4877-ac45-b849f46e95f5 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:30.438294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2961-b4f8-4877-ac45-b849f46e95f5 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:30.440363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 598/1193] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:55:30.445570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7fa49-be5f-4260-94f2-92407710d4d7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:30.445989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7fa49-be5f-4260-94f2-92407710d4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:30.446099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7fa49-be5f-4260-94f2-92407710d4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:30.464481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-8cd7fa49-be5f-4260-94f2-92407710d4d7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:55:30.465652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8cd7fa49-be5f-4260-94f2-92407710d4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:55:30.529954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 596/1194] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:55:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:55:30.800098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a2961-b4f8-4877-ac45-b849f46e95f5 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:30.898996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a2961-b4f8-4877-ac45-b849f46e95f5 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:30.933412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:30.934059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:30.934339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:30.934612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:30.945100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:55:30.949811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:55:30.950912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:55:30.951935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 599/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:55:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:55:30.957245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7fa49-be5f-4260-94f2-92407710d4d7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:30.959380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:31.056368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7fa49-be5f-4260-94f2-92407710d4d7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:31.089763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:31.090367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:31.090672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:31.090946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:31.091606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:31.091947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:31.093314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:31.101987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 597/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:55:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:31.107693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:31.113451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:31.209817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2797e5-2521-41e4-b96c-d0a11654d261 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:31.243073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:31.243704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:31.244031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:31.244306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] PATH_INFO: `/v3/users/6af9a1b328a6496eac22072514c0eae4` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:31.245441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] RBAC: Authorizing `identity:get_user(user_id=6af9a1b328a6496eac22072514c0eae4)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:31.246876 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:31.248689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 600/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Thu Aug 25 04:55:31 2022] GET /identity/v3/users/6af9a1b328a6496eac22072514c0eae4 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:31.254649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:31.314089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:31.350973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161696c4-2d9e-402a-ad0f-7e25cfd05f62 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:31.382880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:31.383467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:31.383742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:31.384044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:31.448529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:31.449994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:31.508120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:31.543919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 598/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:55:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:55:31.550532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:31.619215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:31.647815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db901f2-fc32-4d96-b6e2-32b7f6ac03fd None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:31.681556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bf9af-1a8f-41f6-ae0b-5645b3f7ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:31.682174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf9af-1a8f-41f6-ae0b-5645b3f7ca11 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:31.682449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf9af-1a8f-41f6-ae0b-5645b3f7ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:31.682714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bf9af-1a8f-41f6-ae0b-5645b3f7ca11 None admin] PATH_INFO: `/v3/projects/706f68014ef848f6ab7710d48bb1632e` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:31.683828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bf9af-1a8f-41f6-ae0b-5645b3f7ca11 None admin] RBAC: Authorizing `identity:get_project(project_id=706f68014ef848f6ab7710d48bb1632e)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:31.685273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bf9af-1a8f-41f6-ae0b-5645b3f7ca11 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:31.686887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 601/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Thu Aug 25 04:55:31 2022] GET /identity/v3/projects/706f68014ef848f6ab7710d48bb1632e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:31.693109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:55:31.797626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3389323-6b2f-4a02-93c0-ee4997c04d94 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:55:31.830723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d0114-d564-48eb-9d4c-09cc1e217842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:55:31.831317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0114-d564-48eb-9d4c-09cc1e217842 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:55:31.831600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0114-d564-48eb-9d4c-09cc1e217842 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:55:31.831870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d0114-d564-48eb-9d4c-09cc1e217842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:55:31.832614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0114-d564-48eb-9d4c-09cc1e217842 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=706f68014ef848f6ab7710d48bb1632e, user.id=6af9a1b328a6496eac22072514c0eae4) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:55:31.832922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0114-d564-48eb-9d4c-09cc1e217842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:55:31.834354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d0114-d564-48eb-9d4c-09cc1e217842 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:55:31.839926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 599/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:55:31 2022] GET /identity/v3/role_assignments?user.id=6af9a1b328a6496eac22072514c0eae4&scope.project.id=706f68014ef848f6ab7710d48bb1632e&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:55:41.677466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=30 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:55:41.837430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=86 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:50.515864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134da107-4150-4a0b-8ec6-760a2b99f01d None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:50.516509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134da107-4150-4a0b-8ec6-760a2b99f01d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:50.516509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134da107-4150-4a0b-8ec6-760a2b99f01d None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:50.517838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 602/1201] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:56:50.523154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005ca57-0dc4-4736-ab54-48031ef61373 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:50.523548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005ca57-0dc4-4736-ab54-48031ef61373 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:50.523725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005ca57-0dc4-4736-ab54-48031ef61373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:50.542500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9005ca57-0dc4-4736-ab54-48031ef61373 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:56:50.545826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9005ca57-0dc4-4736-ab54-48031ef61373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:56:50.611531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 600/1202] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:56:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:56:50.892744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134da107-4150-4a0b-8ec6-760a2b99f01d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:50.992027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134da107-4150-4a0b-8ec6-760a2b99f01d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:51.028310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:51.028934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:51.029208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:51.029591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:51.041003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:51.042516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:56:51.057372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:51.058547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:56:51.059804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:56:51.059804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:51.059804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:56:51.059804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 603/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:51.065384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005ca57-0dc4-4736-ab54-48031ef61373 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:51.163225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005ca57-0dc4-4736-ab54-48031ef61373 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:51.191010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:51.196491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c89399-0a88-4a0c-af08-7ced5bb34724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:51.197086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89399-0a88-4a0c-af08-7ced5bb34724 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:51.197358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89399-0a88-4a0c-af08-7ced5bb34724 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:51.197626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c89399-0a88-4a0c-af08-7ced5bb34724 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:51.198256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c89399-0a88-4a0c-af08-7ced5bb34724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:51.198555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c89399-0a88-4a0c-af08-7ced5bb34724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:51.199947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c89399-0a88-4a0c-af08-7ced5bb34724 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:51.210869 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 601/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:51.217572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:51.269889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:51.314864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf25c9-0cc0-41b8-ae03-cf470709e5c5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:51.347298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb231a-a32d-4906-a4e9-0b52d1db5ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:51.354098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb231a-a32d-4906-a4e9-0b52d1db5ea1 None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:51.354098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb231a-a32d-4906-a4e9-0b52d1db5ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:51.354098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb231a-a32d-4906-a4e9-0b52d1db5ea1 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:51.354098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb231a-a32d-4906-a4e9-0b52d1db5ea1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:51.354098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb231a-a32d-4906-a4e9-0b52d1db5ea1 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:51.494016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 604/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Thu Aug 25 04:56:51 2022] POST /identity/v3/users => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 04:56:53.436975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f30ec-ae64-44fa-a2b5-8fe38f5b1ee5 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:53.437521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f30ec-ae64-44fa-a2b5-8fe38f5b1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:53.437521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f30ec-ae64-44fa-a2b5-8fe38f5b1ee5 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:53.438921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 602/1206] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:56:53.443937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bfedf-7db1-44bc-a4df-a0aabfafdd73 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:53.444367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bfedf-7db1-44bc-a4df-a0aabfafdd73 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:53.444519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bfedf-7db1-44bc-a4df-a0aabfafdd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:53.462686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-529bfedf-7db1-44bc-a4df-a0aabfafdd73 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:56:53.463883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-529bfedf-7db1-44bc-a4df-a0aabfafdd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:56:53.532205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 605/1207] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:56:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:56:53.810488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f30ec-ae64-44fa-a2b5-8fe38f5b1ee5 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:53.911658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f30ec-ae64-44fa-a2b5-8fe38f5b1ee5 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:53.944486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:53.945138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:53.945410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:53.945677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:53.956177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:56:53.960782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:53.962014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:56:53.963190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:53.970542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 603/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:56:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:53.974769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bfedf-7db1-44bc-a4df-a0aabfafdd73 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:54.008175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:54.066693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bfedf-7db1-44bc-a4df-a0aabfafdd73 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:54.102314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:54.102916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:54.103195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:54.103468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:54.104162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:54.104464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:54.105900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:54.113860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 606/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:54.119568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:54.169772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:54.217573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30876062-5ba8-440f-856a-3dcf7e8e0433 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:54.251031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:54.251646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:54.251947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:54.252214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:54.261815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:54.263254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:56:54.278434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:54.280944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:56:54.282090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:56:54.282090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:54.282090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:54.282090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 604/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:54.285830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:54.382098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:54.384945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850f3cd-29af-4288-b1ff-eae832245f44 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:54.418685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:54.419294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:54.419564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:54.419871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:54.421336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:54.421639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:54.423008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:54.434348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 607/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:56:54.440154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:54.539769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8cb83-bd21-4513-8e51-2eb88543b343 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:54.541306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:54.572479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:54.573090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:54.573363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:54.573630 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:54.580868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:54.582318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:56:54.594830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:54.596137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:54.597183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 605/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:56:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:54.602134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:54.703046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aada6-d4bb-43b7-86c6-f06b8b9203e6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:54.747243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:54.748119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:54.748470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:54.748815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:54.749705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:54.750093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:54.751608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:54.771142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 608/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 25 04:56:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:54.776978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:54.886370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62be245-64da-45a5-b3cb-04a5466e94f7 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:54.922462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:54.923065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:54.923337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:54.923604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:54.953245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:54.990526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:54.991998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:55.085386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 606/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:56:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 04:56:55.091234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:55.112530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:55.189687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef802273-7163-475b-a59c-f1e7597b573f None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:55.222716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:55.223334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:55.223609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:55.223874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:55.234545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:55.236047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:56:55.250336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:55.251497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:56:55.252801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:56:55.252801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:55.252801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:56:55.252801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 609/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:55.257238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:55.317598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:55.356921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bb461-688c-417f-a7b3-957b62cffc6c None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:55.390410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:55.391003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:55.391279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:55.391550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:55.392214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:55.392516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:55.393872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:55.405890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 607/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:55.411651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:55.480402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:55.511009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606818f-8a00-4351-b357-4d4844cad600 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:55.545284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:55.545918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:55.546201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:55.546477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:55.553283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:55.554738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:56:55.565799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:55.566981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:56:55.567945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 610/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:56:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:55.572894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:55.674967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b54b-f783-44bd-acf5-549eebd08ffc None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:55.700587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:55.712505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa391e20-a6b2-452c-81fb-d60ff2f28b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:55.713138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa391e20-a6b2-452c-81fb-d60ff2f28b98 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:55.713415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa391e20-a6b2-452c-81fb-d60ff2f28b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:55.713800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa391e20-a6b2-452c-81fb-d60ff2f28b98 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:55.714784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa391e20-a6b2-452c-81fb-d60ff2f28b98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:55.715089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa391e20-a6b2-452c-81fb-d60ff2f28b98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:55.716561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa391e20-a6b2-452c-81fb-d60ff2f28b98 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:55.728726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 608/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:55.735071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:55.834519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df5929-11c1-483c-91bc-2d261b3348ae None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:55.862597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:55.868224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e242b-2f56-43c8-b78d-587588859fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:55.868817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e242b-2f56-43c8-b78d-587588859fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:55.869095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e242b-2f56-43c8-b78d-587588859fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:55.869365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e242b-2f56-43c8-b78d-587588859fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:55.870083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e242b-2f56-43c8-b78d-587588859fb4 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=33f5a7148e3c4598ba93d35af2d564aa) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:55.870385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e242b-2f56-43c8-b78d-587588859fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:55.871806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e242b-2f56-43c8-b78d-587588859fb4 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:55.877114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 611/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:56:55 2022] GET /identity/v3/role_assignments?user.id=33f5a7148e3c4598ba93d35af2d564aa&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:57.759190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80321765-b007-4fc0-92df-d0bd22f84050 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:57.759734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80321765-b007-4fc0-92df-d0bd22f84050 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:57.759734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80321765-b007-4fc0-92df-d0bd22f84050 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:57.761156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 609/1220] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:56:57.766945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf49fd-b945-45a9-9099-565444154afd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:57.767387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf49fd-b945-45a9-9099-565444154afd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:57.767493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf49fd-b945-45a9-9099-565444154afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:57.786138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7acf49fd-b945-45a9-9099-565444154afd None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:56:57.787318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7acf49fd-b945-45a9-9099-565444154afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:56:57.853674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 612/1221] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:56:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:56:58.123960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80321765-b007-4fc0-92df-d0bd22f84050 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:58.223897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80321765-b007-4fc0-92df-d0bd22f84050 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:58.258029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:58.258645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:58.258920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:58.259197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:58.269671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:56:58.274289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:58.275389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:58.276558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 610/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:58.282237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf49fd-b945-45a9-9099-565444154afd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:58.378174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf49fd-b945-45a9-9099-565444154afd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:58.402299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:58.413266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:58.413919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:58.414196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:58.414466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:58.415120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:58.415419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:58.416807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:58.424924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 613/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:58.430830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:58.475671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:58.531143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a277c5-f55c-42ed-a963-2fa9eb194cf6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:58.564411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:58.565033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:58.565309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:58.565580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:58.575847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:58.577850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:56:58.591408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:58.593206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:56:58.594328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:56:58.594328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:58.594328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:58.594328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 611/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:58.599205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:58.699283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033757c-a656-4073-8879-79597540a2b5 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:58.733315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:58.733948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:58.734266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:58.734503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:58.735140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:58.735444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:58.736859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:58.749113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 614/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:58.754809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:58.847709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:58.854491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9506a1-e902-42a8-915c-16f35310d02e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:58.887067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:58.887682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:58.889978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:58.889978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:58.896501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:58.897951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:56:58.909772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:58.910730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:58.911737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 612/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:56:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:58.916794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:58.964402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:59.017395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc50372-4875-4804-b5e2-eb399d042b48 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:59.051460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:59.052099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:59.052375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:59.052646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:59.053361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:59.053665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:59.055150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:59.071780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 615/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 25 04:56:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:59.078087 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:59.176940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ab34e-1808-4c71-8a6c-d0b682bd4c51 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:59.209197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:59.209815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:59.210090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:59.210357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:59.221119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:59.222492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:56:59.236223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:59.237437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:56:59.238540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:56:59.238540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:56:59.238540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:59.238540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 613/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:59.243223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:59.346576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46390a-57ce-4286-aad6-5eeecd3113a0 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:59.348867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:59.379857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:59.384794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:59.384794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:59.384794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:59.384794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:59.384794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:59.384794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:59.394873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 616/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:56:59.400788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:59.410736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:59.499541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f684e-d2a5-4de2-a9fc-026f4a1dd113 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:59.532090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:59.532707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:59.532983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:59.533254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:59.539744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:59.541232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:56:59.554210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:56:59.555337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:56:59.556496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 614/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:56:59.561510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:59.661528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9cdf5-c2dd-429f-9eba-40c661147c06 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:59.696368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea21f5c-6fb8-4e84-9601-cf3a3c684761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:59.696968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21f5c-6fb8-4e84-9601-cf3a3c684761 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:59.697241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21f5c-6fb8-4e84-9601-cf3a3c684761 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:59.697515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea21f5c-6fb8-4e84-9601-cf3a3c684761 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:59.698195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea21f5c-6fb8-4e84-9601-cf3a3c684761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:56:59.698502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea21f5c-6fb8-4e84-9601-cf3a3c684761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:59.700112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea21f5c-6fb8-4e84-9601-cf3a3c684761 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:59.712342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 617/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:56:59.719507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:56:59.789464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:56:59.823728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740bfe5-85ff-45fe-ab82-3ddd70547c19 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:56:59.857097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1b0c-37f1-4411-8e59-ea31cbf11748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:56:59.858126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1b0c-37f1-4411-8e59-ea31cbf11748 None admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:56:59.858408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1b0c-37f1-4411-8e59-ea31cbf11748 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:56:59.858685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1b0c-37f1-4411-8e59-ea31cbf11748 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/33f5a7148e3c4598ba93d35af2d564aa/roles/0906f5915c62440697970a4f9c746228` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:56:59.875070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1b0c-37f1-4411-8e59-ea31cbf11748 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=33f5a7148e3c4598ba93d35af2d564aa, role_id=0906f5915c62440697970a4f9c746228)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:56:59.876597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1b0c-37f1-4411-8e59-ea31cbf11748 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:56:59.985821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 615/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:56:59 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/33f5a7148e3c4598ba93d35af2d564aa/roles/0906f5915c62440697970a4f9c746228 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:57:01.908894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72fe19-5eef-4b53-9e9c-198ab56de66a None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:01.909456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72fe19-5eef-4b53-9e9c-198ab56de66a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:01.909456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72fe19-5eef-4b53-9e9c-198ab56de66a None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:01.910804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 618/1233] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:01.915880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddc88-7548-478c-bf9f-6122264dbaa0 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:01.916339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddc88-7548-478c-bf9f-6122264dbaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:01.916603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eddc88-7548-478c-bf9f-6122264dbaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:01.934916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-33eddc88-7548-478c-bf9f-6122264dbaa0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:01.936248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-33eddc88-7548-478c-bf9f-6122264dbaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:02.002756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 616/1234] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:57:02.272625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72fe19-5eef-4b53-9e9c-198ab56de66a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:02.298734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:02.379123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72fe19-5eef-4b53-9e9c-198ab56de66a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:02.413235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cb578-3487-4254-a170-983224c0b96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:02.413855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb578-3487-4254-a170-983224c0b96b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:02.414133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb578-3487-4254-a170-983224c0b96b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:02.414403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cb578-3487-4254-a170-983224c0b96b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:02.425034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cb578-3487-4254-a170-983224c0b96b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-408cb578-3487-4254-a170-983224c0b96b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:57:02.429730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:02.430831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:02.431856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 619/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Thu Aug 25 04:57:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:02.437234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddc88-7548-478c-bf9f-6122264dbaa0 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:02.483774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:02.534215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eddc88-7548-478c-bf9f-6122264dbaa0 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:02.568321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:02.568931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:02.569211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:02.569483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:02.570144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:02.570446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:02.571821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:02.579633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 617/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Thu Aug 25 04:57:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:02.585593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cb578-3487-4254-a170-983224c0b96b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:02.672790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:02.687932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cb578-3487-4254-a170-983224c0b96b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:02.721247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:02.721867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:02.722142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:02.722413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:02.732461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:02.736618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:02.749471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:02.750589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:02.751493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:02.751493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:02.751493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:02.751493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 620/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:02.756623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:02.855315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99692644-6e53-4658-8689-e5f2972744a9 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:02.864678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:02.889595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:02.890205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:02.890485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:02.890760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:02.891404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:02.891707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:02.893157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:02.904634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 618/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:02.910522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:03.007664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbef5d-5c99-4d21-95f8-35af0936f8a2 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:03.039525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:03.040173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:03.040447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:03.040758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:03.043356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:03.048885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:03.050314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:57:03.061818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:03.063532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:03.064854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 621/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:03.068700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:03.168118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e366699-97d8-4b2e-8752-a0c2160cdaf6 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:03.202048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:03.202646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:03.202919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:03.203185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:03.203927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:03.204229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:03.205647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:03.222516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 619/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 25 04:57:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:03.228560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:03.326417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbdd21-0f66-45ec-9696-489538dc9025 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:03.359463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:03.360087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:03.360364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:03.360628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:03.420355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:03.426329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:03.427771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:03.523592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 622/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:57:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:57:03.529459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:03.557478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:03.630961 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d27584-d0f7-4e0c-a11b-c361483dcbcb None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:03.664871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:03.665492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:03.665769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:03.666037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:03.680183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:03.680183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:03.694492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:03.700147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:03.701398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:03.701398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:03.701398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:03.701398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 620/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:03.701636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:03.801448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:03.807188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4118779-9e3e-44fd-9655-28814007749b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:03.840386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:03.840987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:03.841265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:03.841566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:03.842349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:03.842656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:03.844057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:03.855178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 623/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:57:03.861707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:03.939094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:03.960008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b646b0-eb32-451f-b39c-cd647417190d None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:03.993483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:03.994106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:03.994385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:03.994656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:04.001333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:04.002817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:57:04.013816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:04.018222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:04.019348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 621/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:04.020944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:04.122265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34a660-00ba-4b2f-b447-cd248ab2a320 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:04.155719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaaaba-c85c-43d8-b7b3-1961b385e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:04.156354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaaaba-c85c-43d8-b7b3-1961b385e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:04.156630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaaaba-c85c-43d8-b7b3-1961b385e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:04.156898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaaaba-c85c-43d8-b7b3-1961b385e6c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:04.157582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaaaba-c85c-43d8-b7b3-1961b385e6c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:04.157883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaaaba-c85c-43d8-b7b3-1961b385e6c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:04.159302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaaaba-c85c-43d8-b7b3-1961b385e6c9 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:04.171640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 624/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:04.177916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:04.276677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6981-9c2b-4e38-93d9-8a15b0facf18 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:04.309737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fe963-c005-4c9b-9e52-cdefb6170ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:04.310405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe963-c005-4c9b-9e52-cdefb6170ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:04.310751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe963-c005-4c9b-9e52-cdefb6170ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:04.310950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe963-c005-4c9b-9e52-cdefb6170ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:04.311666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fe963-c005-4c9b-9e52-cdefb6170ff5 None admin] RBAC: Adding query filter params (role.id=0906f5915c62440697970a4f9c746228, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=33f5a7148e3c4598ba93d35af2d564aa) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:04.311996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fe963-c005-4c9b-9e52-cdefb6170ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:04.313415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fe963-c005-4c9b-9e52-cdefb6170ff5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:04.319045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 622/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:57:04 2022] GET /identity/v3/role_assignments?user.id=33f5a7148e3c4598ba93d35af2d564aa&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=0906f5915c62440697970a4f9c746228 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:06.279641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328e65-3a13-4059-a44f-a1adb6bbfd1c None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:06.280229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328e65-3a13-4059-a44f-a1adb6bbfd1c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:06.280229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e328e65-3a13-4059-a44f-a1adb6bbfd1c None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:06.281596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 625/1247] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:06.286668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d666e2-5ecb-43ce-8a70-3e93c5185943 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:06.287027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d666e2-5ecb-43ce-8a70-3e93c5185943 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:06.287211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d666e2-5ecb-43ce-8a70-3e93c5185943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:06.293531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:06.306053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b9d666e2-5ecb-43ce-8a70-3e93c5185943 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:06.307236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b9d666e2-5ecb-43ce-8a70-3e93c5185943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:06.372248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 623/1248] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:57:06.636670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328e65-3a13-4059-a44f-a1adb6bbfd1c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:06.656240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:06.740117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e328e65-3a13-4059-a44f-a1adb6bbfd1c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:06.773569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:06.774185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:06.774460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:06.774727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:06.785081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:57:06.789653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:06.790770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:06.792006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 626/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:06.796826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d666e2-5ecb-43ce-8a70-3e93c5185943 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:06.894759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d666e2-5ecb-43ce-8a70-3e93c5185943 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:06.926484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:06.931308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:06.931950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:06.932215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:06.932487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:06.933157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:06.933461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:06.934988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:06.944064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 624/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:06.949942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:07.026807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:07.049649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e064b3-0899-45af-8782-2601c6659da2 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:07.081606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:07.082260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:07.082514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:07.082801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:07.092856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:07.094358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:07.109458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:07.110633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:07.111790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:07.111790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:07.111790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:07.111790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 627/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:07.116433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:07.213648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150121c5-62bf-47f2-8530-b7ce435cccbf None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:07.246728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:07.247327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:07.247650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:07.247945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:07.248582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:07.248879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:07.250247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:07.261674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 625/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:07.268168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:07.366245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb924264-dea1-40f4-ab69-744cac189fed None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:07.392159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:07.399999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:07.400622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:07.400899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:07.401171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:07.410438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:07.412446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:57:07.427434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:07.434640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:07.436123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 628/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:07.436744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:07.490831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:07.534865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa24ae2-afbc-4fba-a92f-c9fcc1408a5f None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:07.567506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:07.568135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:07.568410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:07.568676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:07.569387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:07.569687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:07.571107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:07.589169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 626/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 25 04:57:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:07.595733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:07.702539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19715a84-17f6-443c-8d6c-be8d94042d30 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:07.743471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:07.744037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:07.744317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:07.744590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:07.800065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:07.812367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:07.813825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:07.909491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 629/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:57:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:57:07.915346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:08.015521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c16dcf-cbdb-4cdd-8d30-e310d3299c2b None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:08.029774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:08.050777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:08.051401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:08.051677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:08.052061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:08.062192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:08.063674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:08.078065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:08.079209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:08.080147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:08.080147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:08.080147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:08.080147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 627/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:08.086635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:08.173203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:08.184566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2498603-1f89-4103-9866-003f21ed7870 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:08.217886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:08.218479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:08.218754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:08.219022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:08.219648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:08.219969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:08.221332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:08.232485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 630/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:57:08.238170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:08.343375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228c7c5-2ab0-4f0e-949b-e9634a5bdda3 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:08.384013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:08.384633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:08.384906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:08.385215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:08.392440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:08.393866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:57:08.405199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:08.406154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:08.407150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 628/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:08.412275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:08.512028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335abd-f638-445f-b49e-93ad25d05bb6 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:08.545890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f3378-87c3-49e9-8d41-4fb656e52956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:08.546493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f3378-87c3-49e9-8d41-4fb656e52956 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:08.546776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f3378-87c3-49e9-8d41-4fb656e52956 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:08.547049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f3378-87c3-49e9-8d41-4fb656e52956 None admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:08.547736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f3378-87c3-49e9-8d41-4fb656e52956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:08.548073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f3378-87c3-49e9-8d41-4fb656e52956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:08.549566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f3378-87c3-49e9-8d41-4fb656e52956 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:08.561417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 631/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:08.567586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:08.592856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:08.667422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5f44-418c-416e-a67e-ed178686ef8a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:08.702174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64b984-9fa7-4a5f-935e-e2ac73d9cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:08.702784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b984-9fa7-4a5f-935e-e2ac73d9cb83 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:08.703062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b984-9fa7-4a5f-935e-e2ac73d9cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:08.703337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64b984-9fa7-4a5f-935e-e2ac73d9cb83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:08.704093 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64b984-9fa7-4a5f-935e-e2ac73d9cb83 None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=33f5a7148e3c4598ba93d35af2d564aa) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:08.704431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64b984-9fa7-4a5f-935e-e2ac73d9cb83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:08.705875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64b984-9fa7-4a5f-935e-e2ac73d9cb83 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:08.711426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 629/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:57:08 2022] GET /identity/v3/role_assignments?user.id=33f5a7148e3c4598ba93d35af2d564aa&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:10.579585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fca67-acf5-4ae9-9265-a2d9e2ab26d1 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:10.580166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fca67-acf5-4ae9-9265-a2d9e2ab26d1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:10.580166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fca67-acf5-4ae9-9265-a2d9e2ab26d1 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:10.581513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 632/1261] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:10.586784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7756d4-4caf-4fa8-a0ee-e154107c2d5f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:10.587176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7756d4-4caf-4fa8-a0ee-e154107c2d5f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:10.587444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7756d4-4caf-4fa8-a0ee-e154107c2d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:10.605458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5f7756d4-4caf-4fa8-a0ee-e154107c2d5f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:10.606634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5f7756d4-4caf-4fa8-a0ee-e154107c2d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:10.672979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 630/1262] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:57:10.943307 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fca67-acf5-4ae9-9265-a2d9e2ab26d1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:10.954580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:11.050797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fca67-acf5-4ae9-9265-a2d9e2ab26d1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:11.083701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:11.084351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:11.084630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:11.084902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:11.095510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:57:11.100144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:11.103130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:11.104224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 633/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:57:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:11.107806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7756d4-4caf-4fa8-a0ee-e154107c2d5f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:11.126201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:11.207149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7756d4-4caf-4fa8-a0ee-e154107c2d5f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:11.240730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:11.241361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:11.241643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:11.241912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:11.242574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:11.242877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:11.244301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:11.252382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 631/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:57:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:11.258124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:11.327250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:11.359383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccdd1c-2d23-4000-8d0c-0c9985ea5566 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:11.396797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:11.397413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:11.397689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:11.397960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:11.408594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:11.410036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:11.425124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:11.426877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:11.428888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:11.428888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:11.428888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:11.428888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 634/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:11.433133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:11.511222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:11.529484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612b6af-620b-4014-aed8-d9d2067d62d5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:11.562750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:11.563358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:11.563635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:11.563922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:11.564578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:11.564883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:11.566254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:11.577260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 632/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:11.582925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:11.682655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdbaa1-8803-49b3-b5ff-fe7761eb2954 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:11.702557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:11.717050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:11.717728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:11.717954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:11.721240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:11.725558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:11.727251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:57:11.739398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:11.740649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:11.741614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 635/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:11.746459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:11.847055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5136928-f9d5-450b-b9ed-33da0c72d03a None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:11.879693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:11.880334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:11.880612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:11.880880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:11.881600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:11.881904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:11.883366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:11.892899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:11.900575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 633/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 25 04:57:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:11.907206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:12.006280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63828911-5349-48d3-9c25-d39664d8af3c None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:12.040046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:12.040636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:12.040911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:12.041185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:12.052117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:12.053558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:12.067291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:12.068457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:12.069741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:12.069741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:12.069741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:12.069741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 636/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:12.074317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:12.174121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafcdb3-5000-4ebe-aabf-f74a4f4ad336 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:12.208110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:12.208713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:12.208989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:12.209259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:12.209892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:12.210222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:12.211559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:12.222579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 634/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:12.228622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:12.260197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:12.326226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f173f3-9026-40c1-9f29-fac4c704711b None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:12.358812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:12.359425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:12.359716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:12.359990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:12.366410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:12.367882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:57:12.380333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:12.381416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:12.382773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 637/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:12.387298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:12.447294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:12.488400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bef33-d2f4-4167-a4de-16a13b0d6cc0 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:12.521673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0d3d-4e9a-439c-9c15-742d65307f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:12.522325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0d3d-4e9a-439c-9c15-742d65307f59 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:12.522606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0d3d-4e9a-439c-9c15-742d65307f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:12.522881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0d3d-4e9a-439c-9c15-742d65307f59 None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:12.523570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0d3d-4e9a-439c-9c15-742d65307f59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:12.523877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0d3d-4e9a-439c-9c15-742d65307f59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:12.525347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0d3d-4e9a-439c-9c15-742d65307f59 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:12.537752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 635/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:12.543825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:12.634459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:12.643357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e808-de98-4a8d-a222-b38b6beb3c3a None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:12.676382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de509ad-0c4c-4fa6-ad30-de1f31de6763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:12.677032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de509ad-0c4c-4fa6-ad30-de1f31de6763 None admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:12.677312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de509ad-0c4c-4fa6-ad30-de1f31de6763 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:12.677584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de509ad-0c4c-4fa6-ad30-de1f31de6763 None admin] PATH_INFO: `/v3/projects/979e597d43214098951310b4e2c09a31/users/33f5a7148e3c4598ba93d35af2d564aa/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:12.679461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de509ad-0c4c-4fa6-ad30-de1f31de6763 None admin] RBAC: Authorizing `identity:create_grant(project_id=979e597d43214098951310b4e2c09a31, user_id=33f5a7148e3c4598ba93d35af2d564aa, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:12.680927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de509ad-0c4c-4fa6-ad30-de1f31de6763 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:12.774288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 638/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Thu Aug 25 04:57:12 2022] PUT /identity/v3/projects/979e597d43214098951310b4e2c09a31/users/33f5a7148e3c4598ba93d35af2d564aa/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 04:57:14.686644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76786e86-17bc-42f9-9c5a-60be03c8b22e None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:14.687205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76786e86-17bc-42f9-9c5a-60be03c8b22e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:14.687205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76786e86-17bc-42f9-9c5a-60be03c8b22e None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:14.688509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 636/1274] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:14.693714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f395be7-2280-4bac-b774-17d36705be45 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:14.694186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f395be7-2280-4bac-b774-17d36705be45 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:14.694302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f395be7-2280-4bac-b774-17d36705be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:14.715595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5f395be7-2280-4bac-b774-17d36705be45 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:14.715595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5f395be7-2280-4bac-b774-17d36705be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:14.788027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 639/1275] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 04:57:15.053456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76786e86-17bc-42f9-9c5a-60be03c8b22e None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:15.155092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76786e86-17bc-42f9-9c5a-60be03c8b22e None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:15.171856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:15.188974 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:15.189601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:15.189883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:15.190158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:15.200039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 04:57:15.205469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:15.206606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:15.207853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 637/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Thu Aug 25 04:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:15.212629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f395be7-2280-4bac-b774-17d36705be45 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:15.290982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:15.308134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f395be7-2280-4bac-b774-17d36705be45 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:15.347360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:15.348004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:15.348284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:15.348554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:15.349214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:15.349515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:15.350888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:15.358997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 640/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Thu Aug 25 04:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:15.364832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:15.463860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d67d0-3e63-4fb7-b17f-8321c051343e None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:15.498996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:15.499626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:15.499927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:15.500203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:15.510105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:15.511552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:15.526472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:15.527649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:15.529418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:15.529418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:15.529418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:15.529418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 638/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:15.534346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:15.632952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bd257-d060-486f-9569-5e623e873fdd None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:15.666257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:15.666849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:15.667125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:15.667394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:15.668956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:15.669464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:15.671063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:15.682933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 641/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:15.688686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:15.720696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:15.793519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423997a0-7eac-42ca-95cb-f5aa075b3e12 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:15.828560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:15.829199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:15.829480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:15.829754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:15.837180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:15.838632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 04:57:15.850718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:15.852195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:15.853536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 639/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:15.858012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:15.861851 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:15.953588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add71fe-de34-428f-b4bc-b1209ad94bcd None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:15.987529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:15.988172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:15.988453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:15.988721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:15.989440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:15.989745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:15.991170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:16.008686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 642/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Thu Aug 25 04:57:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 04:57:16.014702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:16.103079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:16.112677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c1e04-9e8e-4ed9-b893-984631169e79 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:16.144232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:16.144838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:16.145095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:16.145361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:16.209094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:16.210471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:16.302106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:16.306785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 640/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Thu Aug 25 04:57:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 04:57:16.312770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:16.387405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:16.425361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee99fe-7e44-4e93-b76d-8601cc8d46f7 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:16.458314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:16.459009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:16.462946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:16.462946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:16.470122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:16.471608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 04:57:16.486006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:16.487154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 04:57:16.488129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 04:57:16.488129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 04:57:16.488129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:16.488129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 643/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 04:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:16.492934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:16.592739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83304ee-76dc-42db-831e-4c148a763c86 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:16.626258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:16.626855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:16.627134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:16.627407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:16.628077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:16.628382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:16.629803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:16.641445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 641/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Thu Aug 25 04:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:16.647168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:16.750414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ade656-49ec-4f71-ad92-18469f01be18 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:16.764028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:16.783092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:16.783709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:16.784013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:16.784294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:16.790652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:16.792119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 04:57:16.802906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:16.805133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: ERROR keystone.server.flask.application Aug 25 04:57:16.806371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 644/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Thu Aug 25 04:57:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:16.810671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:16.861487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:16.911504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b45a69-e2a1-4b9c-b530-8e52f9106e65 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:16.945134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63fc7b-23c7-4352-b341-3368a3ec65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:16.945745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fc7b-23c7-4352-b341-3368a3ec65cb None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:16.946010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fc7b-23c7-4352-b341-3368a3ec65cb None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:16.946280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63fc7b-23c7-4352-b341-3368a3ec65cb None admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:16.946963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63fc7b-23c7-4352-b341-3368a3ec65cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:16.947264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63fc7b-23c7-4352-b341-3368a3ec65cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:16.948738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63fc7b-23c7-4352-b341-3368a3ec65cb None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:16.960546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 642/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Thu Aug 25 04:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:16.967477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:17.065379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903d553-4a84-4a15-846b-19b81034e055 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:17.100158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2599a9e-3395-4fc6-bc72-eca924eca69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:17.100766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599a9e-3395-4fc6-bc72-eca924eca69c None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:17.101048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599a9e-3395-4fc6-bc72-eca924eca69c None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:17.101319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599a9e-3395-4fc6-bc72-eca924eca69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:17.102294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2599a9e-3395-4fc6-bc72-eca924eca69c None admin] RBAC: Adding query filter params (role.id=4e7c4376e62c42fca4caecc9b36193ee, scope.project.id=979e597d43214098951310b4e2c09a31, user.id=33f5a7148e3c4598ba93d35af2d564aa) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:17.102604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2599a9e-3395-4fc6-bc72-eca924eca69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:17.104065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2599a9e-3395-4fc6-bc72-eca924eca69c None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:17.109977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 645/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Thu Aug 25 04:57:16 2022] GET /identity/v3/role_assignments?user.id=33f5a7148e3c4598ba93d35af2d564aa&scope.project.id=979e597d43214098951310b4e2c09a31&role.id=4e7c4376e62c42fca4caecc9b36193ee => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:19.060714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74854-0060-4bba-89cc-6084184001fc None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:19.061361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74854-0060-4bba-89cc-6084184001fc None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:19.061361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74854-0060-4bba-89cc-6084184001fc None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:19.062585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 643/1288] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:19.068126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961cc6-ceb7-47f2-bc01-4915213ee24c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:19.068571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961cc6-ceb7-47f2-bc01-4915213ee24c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:19.068692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961cc6-ceb7-47f2-bc01-4915213ee24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:19.087008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-60961cc6-ceb7-47f2-bc01-4915213ee24c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:19.088245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-60961cc6-ceb7-47f2-bc01-4915213ee24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:19.118514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:19.154488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 646/1289] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:57:19.433860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d74854-0060-4bba-89cc-6084184001fc None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:19.534912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d74854-0060-4bba-89cc-6084184001fc None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:19.545296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:19.568496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:19.569515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:19.570019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:19.570509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:19.571489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:19.573071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:19.583043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:19.585091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:19.586287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 644/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:57:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 04:57:19.590183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961cc6-ceb7-47f2-bc01-4915213ee24c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:19.687677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961cc6-ceb7-47f2-bc01-4915213ee24c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:19.725038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f1cfc-b342-488a-bd5e-607597d0f490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:19.725644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1cfc-b342-488a-bd5e-607597d0f490 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:19.725918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1cfc-b342-488a-bd5e-607597d0f490 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:19.726187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1cfc-b342-488a-bd5e-607597d0f490 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:19.727103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f1cfc-b342-488a-bd5e-607597d0f490 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:19.727403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f1cfc-b342-488a-bd5e-607597d0f490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:19.728794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f1cfc-b342-488a-bd5e-607597d0f490 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:19.733653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 647/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 25 04:57:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:19.739465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:19.842452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea053e-6609-4af1-a6ce-58ded1c7a5b5 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:19.876105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6aebe-f273-4078-bf29-7cff43562685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:19.876710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6aebe-f273-4078-bf29-7cff43562685 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:19.876987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6aebe-f273-4078-bf29-7cff43562685 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:19.877258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6aebe-f273-4078-bf29-7cff43562685 None admin] PATH_INFO: `/v3/services` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:19.877883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6aebe-f273-4078-bf29-7cff43562685 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:19.878185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6aebe-f273-4078-bf29-7cff43562685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:19.879552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6aebe-f273-4078-bf29-7cff43562685 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:19.884631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 645/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 25 04:57:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:21.899411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9706-18b9-402a-9845-3e38eff211bf None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:21.899982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9706-18b9-402a-9845-3e38eff211bf None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:21.899982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9706-18b9-402a-9845-3e38eff211bf None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:21.901313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 648/1293] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:21.906985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794420d-62cf-4fda-92e5-661bbd34a5f0 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:21.907412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794420d-62cf-4fda-92e5-661bbd34a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:21.907528 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794420d-62cf-4fda-92e5-661bbd34a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:21.926195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6794420d-62cf-4fda-92e5-661bbd34a5f0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:21.927404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6794420d-62cf-4fda-92e5-661bbd34a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:21.956803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:21.994121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 646/1294] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:57:22.263054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9706-18b9-402a-9845-3e38eff211bf None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:22.295019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:22.363836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9706-18b9-402a-9845-3e38eff211bf None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:22.397108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab81bf-f61e-42a0-bc7e-4166d54e28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:22.397701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab81bf-f61e-42a0-bc7e-4166d54e28fe None admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:22.397975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab81bf-f61e-42a0-bc7e-4166d54e28fe None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:22.398243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab81bf-f61e-42a0-bc7e-4166d54e28fe None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:22.398919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab81bf-f61e-42a0-bc7e-4166d54e28fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:22.400311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab81bf-f61e-42a0-bc7e-4166d54e28fe None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:22.489265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 649/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Thu Aug 25 04:57:22 2022] POST /identity/v3/services => generated 246 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:57:24.414357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2bcb-1062-4447-bbbc-1c3cc7aa57a7 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:24.414906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2bcb-1062-4447-bbbc-1c3cc7aa57a7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:24.414906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2bcb-1062-4447-bbbc-1c3cc7aa57a7 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:24.416434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 647/1296] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:24.422356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442602e-d3a5-4214-954e-b3e3d68c0fdb None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:24.422785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442602e-d3a5-4214-954e-b3e3d68c0fdb None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:24.422898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442602e-d3a5-4214-954e-b3e3d68c0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:24.441022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5442602e-d3a5-4214-954e-b3e3d68c0fdb None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:24.442210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5442602e-d3a5-4214-954e-b3e3d68c0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:24.513502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 650/1297] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:57:24.780215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2bcb-1062-4447-bbbc-1c3cc7aa57a7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:24.891114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2bcb-1062-4447-bbbc-1c3cc7aa57a7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:24.928884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:24.929525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:24.931962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:24.931962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] PATH_INFO: `/v3/services/placement` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:24.931962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:24.932296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:24.941580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:24.942933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:24.944062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:24.947754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 648/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:57:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:24.949258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442602e-d3a5-4214-954e-b3e3d68c0fdb None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:24.969462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:25.054302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442602e-d3a5-4214-954e-b3e3d68c0fdb None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:25.088113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:25.088727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:25.089007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:25.089280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:25.089910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:25.090218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:25.091599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:25.097399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 651/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 25 04:57:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:25.104069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:25.140857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:25.209661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08ddf6-6b48-4ab2-8295-604d90381fea None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:25.243721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433460aa-73e5-424b-bdf9-8a0547e76661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:25.244361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433460aa-73e5-424b-bdf9-8a0547e76661 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:25.244791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433460aa-73e5-424b-bdf9-8a0547e76661 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:25.245065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433460aa-73e5-424b-bdf9-8a0547e76661 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:25.245797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433460aa-73e5-424b-bdf9-8a0547e76661 None admin] RBAC: Adding query filter params (interface=public, service_id=b7f689dd5e1e4f66b1bcc024e6379e04, region_id=RegionOne) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:25.246108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433460aa-73e5-424b-bdf9-8a0547e76661 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:25.247485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433460aa-73e5-424b-bdf9-8a0547e76661 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:25.252574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 649/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Thu Aug 25 04:57:25 2022] GET /identity/v3/endpoints?service_id=b7f689dd5e1e4f66b1bcc024e6379e04&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:25.258358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:25.340538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:25.359360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59efe40-c6d5-484b-9265-d3ed9d858b97 None admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:25.392797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fbf76-1f7f-4a8a-9971-86ad687bf7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:25.393395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fbf76-1f7f-4a8a-9971-86ad687bf7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:25.393671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fbf76-1f7f-4a8a-9971-86ad687bf7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:25.393943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fbf76-1f7f-4a8a-9971-86ad687bf7e5 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:25.394536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fbf76-1f7f-4a8a-9971-86ad687bf7e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:25.395960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fbf76-1f7f-4a8a-9971-86ad687bf7e5 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:25.402554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 652/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Thu Aug 25 04:57:25 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 04:57:27.313805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459f85-3cfb-4e31-8b1d-cb05099b031b None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:27.314352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459f85-3cfb-4e31-8b1d-cb05099b031b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:27.314352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9459f85-3cfb-4e31-8b1d-cb05099b031b None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:27.315673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 650/1302] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 04:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 04:57:27.320938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d251-edb4-4800-ac18-375564570542 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:27.321371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d251-edb4-4800-ac18-375564570542 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:27.321472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d251-edb4-4800-ac18-375564570542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:27.339180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-c768d251-edb4-4800-ac18-375564570542 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 04:57:27.340392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c768d251-edb4-4800-ac18-375564570542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 04:57:27.405570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 653/1303] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 04:57:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 04:57:27.675966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9459f85-3cfb-4e31-8b1d-cb05099b031b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:27.773687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:27.780979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9459f85-3cfb-4e31-8b1d-cb05099b031b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:27.818311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:27.818998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:27.819277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:27.819587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:27.820169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:27.821547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 04:57:27.831916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 04:57:27.833101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application with Lock( Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self._enter() Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application return self.creator() Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application created_value = creator( Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: ERROR keystone.server.flask.application Aug 25 04:57:27.834134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 651/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Thu Aug 25 04:57:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 04:57:27.840239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d251-edb4-4800-ac18-375564570542 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:27.915141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:27.937711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d251-edb4-4800-ac18-375564570542 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:27.971830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e26cf8-df78-4c43-a44b-9cfac087db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:27.972456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26cf8-df78-4c43-a44b-9cfac087db61 None admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:27.972811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26cf8-df78-4c43-a44b-9cfac087db61 None admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:27.973135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26cf8-df78-4c43-a44b-9cfac087db61 None admin] PATH_INFO: `/v3/services` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:27.973763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e26cf8-df78-4c43-a44b-9cfac087db61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 04:57:27.974081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e26cf8-df78-4c43-a44b-9cfac087db61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:27.975432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e26cf8-df78-4c43-a44b-9cfac087db61 None admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:27.980735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 654/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Thu Aug 25 04:57:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 04:57:27.987340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 04:57:28.086081 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4c9dd-f06f-4796-9e19-e412026b7c98 None admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 04:57:28.119814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58781d0d-948e-4d28-8c3c-c8d5b34282b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 04:57:28.120446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d0d-948e-4d28-8c3c-c8d5b34282b5 None admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 04:57:28.120746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d0d-948e-4d28-8c3c-c8d5b34282b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 04:57:28.121026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58781d0d-948e-4d28-8c3c-c8d5b34282b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 04:57:28.121703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781d0d-948e-4d28-8c3c-c8d5b34282b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 04:57:28.123079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58781d0d-948e-4d28-8c3c-c8d5b34282b5 None admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 04:57:28.208818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 652/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 04:57:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 04:57:37.991749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=30 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 04:57:38.204335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:10.300136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3389f-38a4-4d79-b117-5b7e40b197f4 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:10.301429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3389f-38a4-4d79-b117-5b7e40b197f4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:10.302109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3389f-38a4-4d79-b117-5b7e40b197f4 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:10.311640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27059-ccab-4d6a-af9b-b620a6d0434e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:10.311640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27059-ccab-4d6a-af9b-b620a6d0434e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:10.311640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27059-ccab-4d6a-af9b-b620a6d0434e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:10.314216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 655/1307] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:10 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:10.425999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c0d27059-ccab-4d6a-af9b-b620a6d0434e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:10.427208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c0d27059-ccab-4d6a-af9b-b620a6d0434e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:10.543400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 653/1308] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:05:10.848639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f0c8-4b7b-4c2e-a5e0-0f33b6a28d99 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:10.849305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f0c8-4b7b-4c2e-a5e0-0f33b6a28d99 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:10.849832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f0c8-4b7b-4c2e-a5e0-0f33b6a28d99 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:10.852279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 656/1309] 10.222.0.45 () {54 vars in 965 bytes} [Thu Aug 25 05:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:10.859727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f189fb-54b0-476e-bfc3-ac75a31d7d3e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:10.860082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f189fb-54b0-476e-bfc3-ac75a31d7d3e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:10.860310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f189fb-54b0-476e-bfc3-ac75a31d7d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:10.959298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f9f189fb-54b0-476e-bfc3-ac75a31d7d3e None None] MFA Rules not processed for user `3819d2b7da64494f9ed77f670b7c23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:10.960496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f9f189fb-54b0-476e-bfc3-ac75a31d7d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:10.993663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:11.056683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 654/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Aug 25 05:05:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:11.066164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94f0c8-4b7b-4c2e-a5e0-0f33b6a28d99 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:11.068208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6e94f0c8-4b7b-4c2e-a5e0-0f33b6a28d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:11.191324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94f0c8-4b7b-4c2e-a5e0-0f33b6a28d99 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:11.272626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db0f9a-ffd5-43ce-98f4-332e1b26c3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:11.273156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0f9a-ffd5-43ce-98f4-332e1b26c3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:11.273432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0f9a-ffd5-43ce-98f4-332e1b26c3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:11.273703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db0f9a-ffd5-43ce-98f4-332e1b26c3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:11.275344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b0db0f9a-ffd5-43ce-98f4-332e1b26c3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:11.337460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:11.410997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db0f9a-ffd5-43ce-98f4-332e1b26c3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:11.412843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db0f9a-ffd5-43ce-98f4-332e1b26c3e7 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:11.434550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 657/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:13.772754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7413-ed3f-43dc-bf51-8881c2afca09 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:13.773278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7413-ed3f-43dc-bf51-8881c2afca09 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:13.773278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7413-ed3f-43dc-bf51-8881c2afca09 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:13.774634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 655/1312] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:13.779790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6d01e-174c-46e1-b15a-78e0345bce79 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:13.780203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6d01e-174c-46e1-b15a-78e0345bce79 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:13.780372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6d01e-174c-46e1-b15a-78e0345bce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:13.868393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3bd6d01e-174c-46e1-b15a-78e0345bce79 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:13.869774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3bd6d01e-174c-46e1-b15a-78e0345bce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:13.966196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 658/1313] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:14.254600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7413-ed3f-43dc-bf51-8881c2afca09 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:14.256176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-692f7413-ed3f-43dc-bf51-8881c2afca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:14.361909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7413-ed3f-43dc-bf51-8881c2afca09 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:14.432635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:14.435209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9c921-e6b7-4c27-bc03-39fbe306b866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:14.435823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9c921-e6b7-4c27-bc03-39fbe306b866 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:14.436132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9c921-e6b7-4c27-bc03-39fbe306b866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:14.436408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9c921-e6b7-4c27-bc03-39fbe306b866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:14.438012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0bd9c921-e6b7-4c27-bc03-39fbe306b866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:14.545444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9c921-e6b7-4c27-bc03-39fbe306b866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:14.546819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9c921-e6b7-4c27-bc03-39fbe306b866 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:14.564317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 656/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:16.923958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b480d8f-0349-4533-97ef-2f35732183a2 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:16.924514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b480d8f-0349-4533-97ef-2f35732183a2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:16.924514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b480d8f-0349-4533-97ef-2f35732183a2 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:16.925856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 659/1315] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:16.930955 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994441b2-0d8c-458c-b9e7-8c5658f85d22 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:16.931389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994441b2-0d8c-458c-b9e7-8c5658f85d22 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:16.931508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994441b2-0d8c-458c-b9e7-8c5658f85d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:16.997323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-994441b2-0d8c-458c-b9e7-8c5658f85d22 None None] MFA Rules not processed for user `d4028913228d4e89aa295f4b699c2726`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:16.998521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-994441b2-0d8c-458c-b9e7-8c5658f85d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:17.049183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:17.093088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 657/1316] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:17.384299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b480d8f-0349-4533-97ef-2f35732183a2 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:17.386459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6b480d8f-0349-4533-97ef-2f35732183a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:17.396181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:17.487422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b480d8f-0349-4533-97ef-2f35732183a2 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:17.559103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757d89f-8a87-48af-9c63-0c8729dae9f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:17.559696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d89f-8a87-48af-9c63-0c8729dae9f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:17.560006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d89f-8a87-48af-9c63-0c8729dae9f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:17.560276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757d89f-8a87-48af-9c63-0c8729dae9f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:17.561887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c757d89f-8a87-48af-9c63-0c8729dae9f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:17.622507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:17.666836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757d89f-8a87-48af-9c63-0c8729dae9f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:17.668394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757d89f-8a87-48af-9c63-0c8729dae9f7 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:17.687193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 660/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:20.478045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337735a6-6359-4604-b620-fc19480d6285 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:20.478582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337735a6-6359-4604-b620-fc19480d6285 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:20.478582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337735a6-6359-4604-b620-fc19480d6285 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:20.480164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 658/1318] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:20.485572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b329-19f3-40d4-b2c1-c1de92af000a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:20.485981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b329-19f3-40d4-b2c1-c1de92af000a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:20.486152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433b329-19f3-40d4-b2c1-c1de92af000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:20.550750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b433b329-19f3-40d4-b2c1-c1de92af000a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:20.551973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b433b329-19f3-40d4-b2c1-c1de92af000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:20.647849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 661/1319] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:20.933587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337735a6-6359-4604-b620-fc19480d6285 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:20.935107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-337735a6-6359-4604-b620-fc19480d6285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:21.035750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337735a6-6359-4604-b620-fc19480d6285 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:21.114972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce74096-e07a-4709-b77f-62a59887f54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:21.115579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74096-e07a-4709-b77f-62a59887f54d service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:21.115852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74096-e07a-4709-b77f-62a59887f54d service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:21.116148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce74096-e07a-4709-b77f-62a59887f54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:21.117732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7ce74096-e07a-4709-b77f-62a59887f54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:21.125779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:21.226511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce74096-e07a-4709-b77f-62a59887f54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:21.227916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce74096-e07a-4709-b77f-62a59887f54d service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:21.246320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 659/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:24.228811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d9731-8c74-4262-8fb0-45b7e2127ee1 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:24.229354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d9731-8c74-4262-8fb0-45b7e2127ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:24.229354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d9731-8c74-4262-8fb0-45b7e2127ee1 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:24.231086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 662/1321] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:24.236463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3e1e9-cc08-476c-bd07-b57c05718100 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:24.236868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3e1e9-cc08-476c-bd07-b57c05718100 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:24.237144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3e1e9-cc08-476c-bd07-b57c05718100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:24.309858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-94a3e1e9-cc08-476c-bd07-b57c05718100 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:24.311074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-94a3e1e9-cc08-476c-bd07-b57c05718100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:24.368985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:24.410325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 660/1322] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:24.711054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd38ce-274e-48d0-a916-263205c4f8fa None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:24.711335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd38ce-274e-48d0-a916-263205c4f8fa None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:24.711608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd38ce-274e-48d0-a916-263205c4f8fa None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:24.713028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 663/1323] 10.222.0.45 () {54 vars in 965 bytes} [Thu Aug 25 05:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:24.720170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934af35b-42ee-40ad-a0de-38fb73e0ebd4 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:24.720460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934af35b-42ee-40ad-a0de-38fb73e0ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:24.720734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934af35b-42ee-40ad-a0de-38fb73e0ebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:24.797052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-934af35b-42ee-40ad-a0de-38fb73e0ebd4 None None] MFA Rules not processed for user `3819d2b7da64494f9ed77f670b7c23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:24.798270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-934af35b-42ee-40ad-a0de-38fb73e0ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:24.874946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 661/1324] 10.222.0.45 () {58 vars in 1062 bytes} [Thu Aug 25 05:05:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:24.883938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd38ce-274e-48d0-a916-263205c4f8fa None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:24.885522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-25cd38ce-274e-48d0-a916-263205c4f8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:24.906342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:24.996023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd38ce-274e-48d0-a916-263205c4f8fa None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:25.072692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e1a78-f8b1-477a-830b-7dbfd86ef2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:25.073827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e1a78-f8b1-477a-830b-7dbfd86ef2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:25.074113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e1a78-f8b1-477a-830b-7dbfd86ef2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:25.074388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e1a78-f8b1-477a-830b-7dbfd86ef2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:25.076039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8b1e1a78-f8b1-477a-830b-7dbfd86ef2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:25.157631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:25.201128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e1a78-f8b1-477a-830b-7dbfd86ef2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:25.202584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e1a78-f8b1-477a-830b-7dbfd86ef2b1 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:25.222053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 664/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:27.422195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03f1c-592e-49af-9e83-b15828846ce3 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:27.422736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03f1c-592e-49af-9e83-b15828846ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:27.422736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03f1c-592e-49af-9e83-b15828846ce3 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:27.424206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 662/1326] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:27.430248 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772f65-1e75-4abc-96e9-b517eb1e4330 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:27.430782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772f65-1e75-4abc-96e9-b517eb1e4330 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:27.430782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef772f65-1e75-4abc-96e9-b517eb1e4330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:27.500977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ef772f65-1e75-4abc-96e9-b517eb1e4330 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:27.502200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ef772f65-1e75-4abc-96e9-b517eb1e4330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:27.599445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 665/1327] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:27.885208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03f1c-592e-49af-9e83-b15828846ce3 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:27.886768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-73c03f1c-592e-49af-9e83-b15828846ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:27.947022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:27.990795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03f1c-592e-49af-9e83-b15828846ce3 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:28.066827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d37fc-4e32-419d-8bc6-de73dc34f9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:28.067863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d37fc-4e32-419d-8bc6-de73dc34f9cb service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:28.068319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d37fc-4e32-419d-8bc6-de73dc34f9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:28.068726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d37fc-4e32-419d-8bc6-de73dc34f9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:28.071241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2a8d37fc-4e32-419d-8bc6-de73dc34f9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:28.197797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:28.200961 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d37fc-4e32-419d-8bc6-de73dc34f9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:28.202408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d37fc-4e32-419d-8bc6-de73dc34f9cb service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:28.220502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 663/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:30.269659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0a4a9-685e-4b7b-a60f-90139cff390a None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:30.270209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0a4a9-685e-4b7b-a60f-90139cff390a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:30.270209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0a4a9-685e-4b7b-a60f-90139cff390a None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:30.271690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 666/1329] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:30.278533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e393e-c9eb-48da-9b46-3139d2381b6b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:30.279045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e393e-c9eb-48da-9b46-3139d2381b6b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:30.279140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e393e-c9eb-48da-9b46-3139d2381b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:30.357075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-297e393e-c9eb-48da-9b46-3139d2381b6b None None] MFA Rules not processed for user `d4028913228d4e89aa295f4b699c2726`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:30.358588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-297e393e-c9eb-48da-9b46-3139d2381b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:30.468932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 664/1330] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:30.771467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0a4a9-685e-4b7b-a60f-90139cff390a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:30.773304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-31c0a4a9-685e-4b7b-a60f-90139cff390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:30.810807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:30.888117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0a4a9-685e-4b7b-a60f-90139cff390a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:30.964875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e73b0-598c-43a2-8a02-d1106e88257f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:30.965485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e73b0-598c-43a2-8a02-d1106e88257f service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:30.965761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e73b0-598c-43a2-8a02-d1106e88257f service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:30.966032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e73b0-598c-43a2-8a02-d1106e88257f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:30.967661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-009e73b0-598c-43a2-8a02-d1106e88257f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:31.049901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:31.082631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e73b0-598c-43a2-8a02-d1106e88257f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:31.084111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e73b0-598c-43a2-8a02-d1106e88257f service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:31.102194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 667/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:33.683178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67942a5-313e-48d8-88d1-f5c3c4f4fe8a None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:33.683734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67942a5-313e-48d8-88d1-f5c3c4f4fe8a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:33.683840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67942a5-313e-48d8-88d1-f5c3c4f4fe8a None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:33.686182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 665/1332] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:33.691557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec355-4426-41f8-80ef-90520e932948 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:33.692003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec355-4426-41f8-80ef-90520e932948 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:33.692131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec355-4426-41f8-80ef-90520e932948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:33.758254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-059ec355-4426-41f8-80ef-90520e932948 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:33.759454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-059ec355-4426-41f8-80ef-90520e932948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:33.852786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 668/1333] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:34.141553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67942a5-313e-48d8-88d1-f5c3c4f4fe8a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:34.143074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b67942a5-313e-48d8-88d1-f5c3c4f4fe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:34.212395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:34.247509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67942a5-313e-48d8-88d1-f5c3c4f4fe8a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:34.320869 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71a0c4-4708-4ee6-9239-9dbf58348ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:34.321474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71a0c4-4708-4ee6-9239-9dbf58348ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:34.321751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71a0c4-4708-4ee6-9239-9dbf58348ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:34.322021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71a0c4-4708-4ee6-9239-9dbf58348ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:34.324178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9f71a0c4-4708-4ee6-9239-9dbf58348ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:34.431337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71a0c4-4708-4ee6-9239-9dbf58348ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:34.432837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71a0c4-4708-4ee6-9239-9dbf58348ff8 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:34.442550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:34.450972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 666/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:36.491080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fa6a-6b3f-4749-8b9d-2c1f8a3273b8 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:36.491651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fa6a-6b3f-4749-8b9d-2c1f8a3273b8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:36.491762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fa6a-6b3f-4749-8b9d-2c1f8a3273b8 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:36.493177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 669/1335] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:36.499232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afbfe6-6c0b-41d4-b4f0-8481dd90c027 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:36.499703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afbfe6-6c0b-41d4-b4f0-8481dd90c027 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:36.499788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afbfe6-6c0b-41d4-b4f0-8481dd90c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:36.566818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-d9afbfe6-6c0b-41d4-b4f0-8481dd90c027 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:36.568108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d9afbfe6-6c0b-41d4-b4f0-8481dd90c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:36.673987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 667/1336] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:05:36.962115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93fa6a-6b3f-4749-8b9d-2c1f8a3273b8 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:36.963688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0a93fa6a-6b3f-4749-8b9d-2c1f8a3273b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:37.003201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:37.066407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93fa6a-6b3f-4749-8b9d-2c1f8a3273b8 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:37.141225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd8d1-ace3-4522-a0e8-a011fe33db17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:37.141826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd8d1-ace3-4522-a0e8-a011fe33db17 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:37.142100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd8d1-ace3-4522-a0e8-a011fe33db17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:37.142366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd8d1-ace3-4522-a0e8-a011fe33db17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:37.143998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-eebcd8d1-ace3-4522-a0e8-a011fe33db17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:37.227689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:37.254258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcd8d1-ace3-4522-a0e8-a011fe33db17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:37.255738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcd8d1-ace3-4522-a0e8-a011fe33db17 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:37.274370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 670/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:39.944432 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58acc9e-56d4-4c55-8b98-d49212aabd5e None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:39.944928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58acc9e-56d4-4c55-8b98-d49212aabd5e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:39.945043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58acc9e-56d4-4c55-8b98-d49212aabd5e None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:39.946331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 668/1338] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:39.951641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb6e7-1233-4e18-87d0-51366117ecd3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:39.952039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb6e7-1233-4e18-87d0-51366117ecd3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:39.952232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb6e7-1233-4e18-87d0-51366117ecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:40.017940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-81efb6e7-1233-4e18-87d0-51366117ecd3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:40.019144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81efb6e7-1233-4e18-87d0-51366117ecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:40.114204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 671/1339] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:40.396227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58acc9e-56d4-4c55-8b98-d49212aabd5e None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:40.397773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f58acc9e-56d4-4c55-8b98-d49212aabd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:40.474588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:40.502290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58acc9e-56d4-4c55-8b98-d49212aabd5e None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:40.576740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e9523-6a7b-4d68-b35d-fb4781ce708d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:40.577343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9523-6a7b-4d68-b35d-fb4781ce708d service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:40.577619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9523-6a7b-4d68-b35d-fb4781ce708d service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:40.577886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e9523-6a7b-4d68-b35d-fb4781ce708d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:40.579463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e33e9523-6a7b-4d68-b35d-fb4781ce708d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:40.691957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e9523-6a7b-4d68-b35d-fb4781ce708d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:40.693404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e9523-6a7b-4d68-b35d-fb4781ce708d service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:40.712338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 669/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:44.873157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530c23-3987-45ba-a293-078a89a9b5d8 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:44.873749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530c23-3987-45ba-a293-078a89a9b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:44.873749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530c23-3987-45ba-a293-078a89a9b5d8 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:44.875069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 672/1341] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:44.880515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798357-e829-47af-8c3b-63d638789430 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:44.880966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798357-e829-47af-8c3b-63d638789430 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:44.881091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798357-e829-47af-8c3b-63d638789430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:44.887192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:44.948601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4b798357-e829-47af-8c3b-63d638789430 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:44.949805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4b798357-e829-47af-8c3b-63d638789430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:45.053318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 670/1342] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:45.346223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530c23-3987-45ba-a293-078a89a9b5d8 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:45.347853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-21530c23-3987-45ba-a293-078a89a9b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:45.396729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:45.452412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530c23-3987-45ba-a293-078a89a9b5d8 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:45.525704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474f21-e88e-4574-9d87-4a6cde77ad60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:45.526309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474f21-e88e-4574-9d87-4a6cde77ad60 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:45.526586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474f21-e88e-4574-9d87-4a6cde77ad60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:45.526857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474f21-e88e-4574-9d87-4a6cde77ad60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:45.528471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1e474f21-e88e-4574-9d87-4a6cde77ad60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:45.623636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:45.639621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e474f21-e88e-4574-9d87-4a6cde77ad60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:45.641095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e474f21-e88e-4574-9d87-4a6cde77ad60 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:45.660221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 673/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:48.486850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057912d-c13e-4690-8e65-5bccc706fa70 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:48.487380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057912d-c13e-4690-8e65-5bccc706fa70 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:48.487380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057912d-c13e-4690-8e65-5bccc706fa70 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:48.488771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 671/1344] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:48.494642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c509a-9fc2-43ea-af14-53f63cd895ac None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:48.495146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c509a-9fc2-43ea-af14-53f63cd895ac None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:48.495376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c509a-9fc2-43ea-af14-53f63cd895ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:48.563229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-dd7c509a-9fc2-43ea-af14-53f63cd895ac None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:48.564476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-dd7c509a-9fc2-43ea-af14-53f63cd895ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:48.662811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 674/1345] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:48.945102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057912d-c13e-4690-8e65-5bccc706fa70 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:48.946719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4057912d-c13e-4690-8e65-5bccc706fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:49.041833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:49.058880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057912d-c13e-4690-8e65-5bccc706fa70 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:49.132722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caafa0d-8086-4b4e-86a3-681c0eb8e863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:49.133334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caafa0d-8086-4b4e-86a3-681c0eb8e863 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:49.133612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caafa0d-8086-4b4e-86a3-681c0eb8e863 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:49.133885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caafa0d-8086-4b4e-86a3-681c0eb8e863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:49.136308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1caafa0d-8086-4b4e-86a3-681c0eb8e863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:49.249534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caafa0d-8086-4b4e-86a3-681c0eb8e863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:49.251074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caafa0d-8086-4b4e-86a3-681c0eb8e863 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:49.271307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 672/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:53.768699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedae09-fb5f-4b39-870f-9a47b85d5434 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:53.769165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedae09-fb5f-4b39-870f-9a47b85d5434 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:53.769276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedae09-fb5f-4b39-870f-9a47b85d5434 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:53.770630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 675/1347] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:53.776188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935fea-1cab-4a8b-946e-fe95cb6ef505 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:53.776677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935fea-1cab-4a8b-946e-fe95cb6ef505 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:53.776770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f935fea-1cab-4a8b-946e-fe95cb6ef505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:53.793917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:53.847343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5f935fea-1cab-4a8b-946e-fe95cb6ef505 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:53.848596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5f935fea-1cab-4a8b-946e-fe95cb6ef505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:53.954762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 673/1348] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:05:54.257999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedae09-fb5f-4b39-870f-9a47b85d5434 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:05:54.257999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7dedae09-fb5f-4b39-870f-9a47b85d5434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:54.310925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:54.357456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedae09-fb5f-4b39-870f-9a47b85d5434 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:05:54.429019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0774ce6-f6e1-404b-a2af-3d02bd3d02ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:05:54.429627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774ce6-f6e1-404b-a2af-3d02bd3d02ae service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:54.429905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774ce6-f6e1-404b-a2af-3d02bd3d02ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:54.430176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0774ce6-f6e1-404b-a2af-3d02bd3d02ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:54.431800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c0774ce6-f6e1-404b-a2af-3d02bd3d02ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:54.535298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:54.538699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0774ce6-f6e1-404b-a2af-3d02bd3d02ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:05:54.540186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0774ce6-f6e1-404b-a2af-3d02bd3d02ae service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:05:54.558911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 676/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:05:59.481615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0100-d683-4b2a-b442-bc7296a693d6 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:59.482136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0100-d683-4b2a-b442-bc7296a693d6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:59.482659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0100-d683-4b2a-b442-bc7296a693d6 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:59.484190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 674/1350] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:05:59.489162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51649c50-26b2-4745-9c56-7ec9186ca441 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:05:59.489593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51649c50-26b2-4745-9c56-7ec9186ca441 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:05:59.489757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51649c50-26b2-4745-9c56-7ec9186ca441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:05:59.628012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-51649c50-26b2-4745-9c56-7ec9186ca441 None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:05:59.628012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-51649c50-26b2-4745-9c56-7ec9186ca441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:05:59.788159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 677/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:05:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:03.952582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=59 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:03.992208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76c56a-9cf9-4532-9a72-f69426f5cb47 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:03.993024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76c56a-9cf9-4532-9a72-f69426f5cb47 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:03.993707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76c56a-9cf9-4532-9a72-f69426f5cb47 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:03.995354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 675/1352] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:04.000746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d0ac-8f19-4618-a931-be8bab1df525 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:04.001254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d0ac-8f19-4618-a931-be8bab1df525 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:04.001339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d0ac-8f19-4618-a931-be8bab1df525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:04.060881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:04.086131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1266d0ac-8f19-4618-a931-be8bab1df525 None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:04.089273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1266d0ac-8f19-4618-a931-be8bab1df525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:04.212811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 678/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:06:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:05.496416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb99e-752c-4cd2-854a-0cdf9e1cf0ce None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:05.496973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb99e-752c-4cd2-854a-0cdf9e1cf0ce None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:05.497076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fb99e-752c-4cd2-854a-0cdf9e1cf0ce None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:05.498357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 676/1354] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:05.503563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ff48-fb34-40cc-b3b5-4007802723a7 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:05.504005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ff48-fb34-40cc-b3b5-4007802723a7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:05.504188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ff48-fb34-40cc-b3b5-4007802723a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:05.584025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b030ff48-fb34-40cc-b3b5-4007802723a7 None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:05.585239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b030ff48-fb34-40cc-b3b5-4007802723a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:05.629147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:05.696508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 679/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:06:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:09.090094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d407f-69b4-4139-a740-bbc87abae0b4 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:09.090653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d407f-69b4-4139-a740-bbc87abae0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:09.090653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d407f-69b4-4139-a740-bbc87abae0b4 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:09.092197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 677/1356] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:09.097168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425dc98-a828-4115-97c6-9c57ee29c878 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:09.098180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425dc98-a828-4115-97c6-9c57ee29c878 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:09.098180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425dc98-a828-4115-97c6-9c57ee29c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:09.195711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8425dc98-a828-4115-97c6-9c57ee29c878 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:09.197287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8425dc98-a828-4115-97c6-9c57ee29c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:09.344691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 680/1357] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:09.666299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaf336-443e-4979-a831-a1c1f794f84d None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:09.667004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaf336-443e-4979-a831-a1c1f794f84d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:09.667503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaf336-443e-4979-a831-a1c1f794f84d None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:09.669423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 678/1358] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 25 05:06:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:09.678512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9d3d-feb4-48d1-972e-0fcd13eef87c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:09.679278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9d3d-feb4-48d1-972e-0fcd13eef87c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:09.683240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9d3d-feb4-48d1-972e-0fcd13eef87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:09.710153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:09.769149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-eb3a9d3d-feb4-48d1-972e-0fcd13eef87c None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:09.770357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-eb3a9d3d-feb4-48d1-972e-0fcd13eef87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:09.904340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 681/1359] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 25 05:06:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:09.912353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaf336-443e-4979-a831-a1c1f794f84d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:09.913869 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2fcaf336-443e-4979-a831-a1c1f794f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:10.072419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaf336-443e-4979-a831-a1c1f794f84d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:10.152733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:10.195284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b724ea-3639-442d-bd1d-926022ddc276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:10.195892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b724ea-3639-442d-bd1d-926022ddc276 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:10.196200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b724ea-3639-442d-bd1d-926022ddc276 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:10.196695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b724ea-3639-442d-bd1d-926022ddc276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:10.198334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d6b724ea-3639-442d-bd1d-926022ddc276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:10.292888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b724ea-3639-442d-bd1d-926022ddc276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:10.294494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b724ea-3639-442d-bd1d-926022ddc276 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:10.313322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 679/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:06:12.434797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671544-e3c1-47b4-a988-410b2c58f12c None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:12.435333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671544-e3c1-47b4-a988-410b2c58f12c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:12.435333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671544-e3c1-47b4-a988-410b2c58f12c None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:12.437575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 682/1361] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:12.442425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad41ab-f903-4e52-a24d-ae396b10d1ee None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:12.442939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad41ab-f903-4e52-a24d-ae396b10d1ee None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:12.443035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad41ab-f903-4e52-a24d-ae396b10d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:12.514287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5bad41ab-f903-4e52-a24d-ae396b10d1ee None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:12.515500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5bad41ab-f903-4e52-a24d-ae396b10d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:12.556369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:12.619747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 680/1362] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:12.924375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59671544-e3c1-47b4-a988-410b2c58f12c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:12.925525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-59671544-e3c1-47b4-a988-410b2c58f12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:13.001441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:13.089646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59671544-e3c1-47b4-a988-410b2c58f12c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:13.209565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae7ab6-cb64-4ec1-9b3d-a4cc8b79c684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:13.210092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae7ab6-cb64-4ec1-9b3d-a4cc8b79c684 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:13.210374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae7ab6-cb64-4ec1-9b3d-a4cc8b79c684 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:13.210648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae7ab6-cb64-4ec1-9b3d-a4cc8b79c684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:13.212926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5aae7ab6-cb64-4ec1-9b3d-a4cc8b79c684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:13.243649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:13.327189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae7ab6-cb64-4ec1-9b3d-a4cc8b79c684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:13.329078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae7ab6-cb64-4ec1-9b3d-a4cc8b79c684 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:13.351599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 683/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:15.766045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798cea0-30ad-47e4-ad55-9b4b209a04b3 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:15.766596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798cea0-30ad-47e4-ad55-9b4b209a04b3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:15.766596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798cea0-30ad-47e4-ad55-9b4b209a04b3 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:15.768891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 681/1364] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:15.773668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0db5a-43d7-4e3e-b2f4-26c6f293932b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:15.774106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0db5a-43d7-4e3e-b2f4-26c6f293932b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:15.774229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0db5a-43d7-4e3e-b2f4-26c6f293932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:15.847001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-eca0db5a-43d7-4e3e-b2f4-26c6f293932b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:15.848253 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-eca0db5a-43d7-4e3e-b2f4-26c6f293932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:15.967654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:15.972168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 684/1365] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:16.276493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a01ce-2ddd-4214-aa98-96c8909a2c1b None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:16.276816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a01ce-2ddd-4214-aa98-96c8909a2c1b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:16.277076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a01ce-2ddd-4214-aa98-96c8909a2c1b None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:16.278476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 682/1366] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 25 05:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:16.284264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89194e-60e7-4e58-b5c2-07bb51663e24 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:16.286430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89194e-60e7-4e58-b5c2-07bb51663e24 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:16.286430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89194e-60e7-4e58-b5c2-07bb51663e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:16.381202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-6f89194e-60e7-4e58-b5c2-07bb51663e24 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:16.382772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6f89194e-60e7-4e58-b5c2-07bb51663e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:16.513157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 685/1367] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 25 05:06:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:16.521449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a01ce-2ddd-4214-aa98-96c8909a2c1b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:16.522985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b11a01ce-2ddd-4214-aa98-96c8909a2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:16.684962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a01ce-2ddd-4214-aa98-96c8909a2c1b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:16.710406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:16.816242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e4ba-8df3-43d9-828a-ed316cee537d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:16.816973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e4ba-8df3-43d9-828a-ed316cee537d service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:16.817073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e4ba-8df3-43d9-828a-ed316cee537d service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:16.817400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e4ba-8df3-43d9-828a-ed316cee537d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:16.818924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2ff6e4ba-8df3-43d9-828a-ed316cee537d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:16.916481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e4ba-8df3-43d9-828a-ed316cee537d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:16.918236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e4ba-8df3-43d9-828a-ed316cee537d service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:16.938210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 683/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:17.449205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1b5d8-e11a-4bed-a3cb-0b3f093e158b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:17.449726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1b5d8-e11a-4bed-a3cb-0b3f093e158b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:17.449726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1b5d8-e11a-4bed-a3cb-0b3f093e158b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:17.451183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 686/1369] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:17.456586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd205b1-e575-496b-bf90-ca3c998c89ed None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:17.456877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd205b1-e575-496b-bf90-ca3c998c89ed None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:17.457154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd205b1-e575-496b-bf90-ca3c998c89ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:17.492343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:17.535837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6fd205b1-e575-496b-bf90-ca3c998c89ed None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:17.537227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6fd205b1-e575-496b-bf90-ca3c998c89ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:17.646844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 684/1370] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:18.243532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64be9-02ca-4b44-91f6-3ce1bc29a624 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:18.243532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64be9-02ca-4b44-91f6-3ce1bc29a624 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:18.243532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64be9-02ca-4b44-91f6-3ce1bc29a624 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:18.246964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 687/1371] 10.222.0.45 () {54 vars in 964 bytes} [Thu Aug 25 05:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:18.249899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3be156-ad3f-47f2-9fdb-4a7db87bb70c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:18.250404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3be156-ad3f-47f2-9fdb-4a7db87bb70c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:18.250571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3be156-ad3f-47f2-9fdb-4a7db87bb70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:18.331251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ac3be156-ad3f-47f2-9fdb-4a7db87bb70c None None] MFA Rules not processed for user `2cc606d7aea34bf09af6ae2dd0f98902`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:18.332510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ac3be156-ad3f-47f2-9fdb-4a7db87bb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:18.381776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:18.414638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 685/1372] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Aug 25 05:06:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:18.422932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64be9-02ca-4b44-91f6-3ce1bc29a624 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:18.424643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-34e64be9-02ca-4b44-91f6-3ce1bc29a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:18.477790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:18.542557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64be9-02ca-4b44-91f6-3ce1bc29a624 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:18.624234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323e667-73ff-4726-8f4e-5e465694836f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:18.625052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323e667-73ff-4726-8f4e-5e465694836f service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:18.625366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323e667-73ff-4726-8f4e-5e465694836f service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:18.625803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323e667-73ff-4726-8f4e-5e465694836f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:18.627546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0323e667-73ff-4726-8f4e-5e465694836f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:18.738247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:18.759100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323e667-73ff-4726-8f4e-5e465694836f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:18.759100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323e667-73ff-4726-8f4e-5e465694836f service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:18.774691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 688/1373] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:19.057078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7075-ef24-49cd-81b1-c52ef0c11fc4 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:19.057470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7075-ef24-49cd-81b1-c52ef0c11fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:19.057817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7075-ef24-49cd-81b1-c52ef0c11fc4 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:19.059327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 686/1374] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:19.064766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2cb4-8702-41cf-a1da-16c508646dc2 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:19.065091 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2cb4-8702-41cf-a1da-16c508646dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:19.065372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce2cb4-8702-41cf-a1da-16c508646dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:19.135130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f9ce2cb4-8702-41cf-a1da-16c508646dc2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:19.136420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f9ce2cb4-8702-41cf-a1da-16c508646dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:19.238145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 689/1375] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:19.544107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7075-ef24-49cd-81b1-c52ef0c11fc4 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:19.545759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7a7d7075-ef24-49cd-81b1-c52ef0c11fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:19.702122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7075-ef24-49cd-81b1-c52ef0c11fc4 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:19.753716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:19.818954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70d0a5-f3e9-40da-8176-63d92b8b1579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:19.819667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70d0a5-f3e9-40da-8176-63d92b8b1579 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:19.820060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70d0a5-f3e9-40da-8176-63d92b8b1579 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:19.820409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70d0a5-f3e9-40da-8176-63d92b8b1579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:19.822708 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5b70d0a5-f3e9-40da-8176-63d92b8b1579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:19.914995 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70d0a5-f3e9-40da-8176-63d92b8b1579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:19.916631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70d0a5-f3e9-40da-8176-63d92b8b1579 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:19.935933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 687/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:22.049322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb944e-c368-418f-a314-4d4232f60196 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:22.049819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb944e-c368-418f-a314-4d4232f60196 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:22.049926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb944e-c368-418f-a314-4d4232f60196 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:22.051515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 690/1377] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:22.057291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe58b6-6a29-4693-9056-7dc64e28d320 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:22.057740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe58b6-6a29-4693-9056-7dc64e28d320 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:22.057840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe58b6-6a29-4693-9056-7dc64e28d320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:22.142710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-dbbe58b6-6a29-4693-9056-7dc64e28d320 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:22.143849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-dbbe58b6-6a29-4693-9056-7dc64e28d320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:22.150966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:22.242608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 688/1378] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:22.549878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb944e-c368-418f-a314-4d4232f60196 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:22.551676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6bbb944e-c368-418f-a314-4d4232f60196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:22.644563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:22.755872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb944e-c368-418f-a314-4d4232f60196 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:22.882368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc495c-66fb-4aaa-8010-231b0a799818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:22.882978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc495c-66fb-4aaa-8010-231b0a799818 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:22.883263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc495c-66fb-4aaa-8010-231b0a799818 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:22.884634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc495c-66fb-4aaa-8010-231b0a799818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:22.886085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-77fc495c-66fb-4aaa-8010-231b0a799818 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:22.904635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:22.976909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc495c-66fb-4aaa-8010-231b0a799818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:22.978557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc495c-66fb-4aaa-8010-231b0a799818 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:23.006660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 691/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:25.155044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40d71-9181-4bca-a266-8e4d57023f93 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:25.155610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40d71-9181-4bca-a266-8e4d57023f93 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:25.155610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40d71-9181-4bca-a266-8e4d57023f93 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:25.156935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 689/1380] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:25.162282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944b0b-d357-4a42-a05f-22abcaeac56c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:25.162698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944b0b-d357-4a42-a05f-22abcaeac56c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:25.162821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d944b0b-d357-4a42-a05f-22abcaeac56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:25.234246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1d944b0b-d357-4a42-a05f-22abcaeac56c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:25.235372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1d944b0b-d357-4a42-a05f-22abcaeac56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:25.333913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:25.347296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 692/1381] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:25.634144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40d71-9181-4bca-a266-8e4d57023f93 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:25.635872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-99f40d71-9181-4bca-a266-8e4d57023f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:25.798194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:25.810430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40d71-9181-4bca-a266-8e4d57023f93 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:25.928614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245f5e1-b322-437d-a851-0734c3d96f8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:25.929315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f5e1-b322-437d-a851-0734c3d96f8f service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:25.929587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f5e1-b322-437d-a851-0734c3d96f8f service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:25.929849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245f5e1-b322-437d-a851-0734c3d96f8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:25.932198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f245f5e1-b322-437d-a851-0734c3d96f8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:26.026666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245f5e1-b322-437d-a851-0734c3d96f8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:26.028442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245f5e1-b322-437d-a851-0734c3d96f8f service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:26.039383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:26.048908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 690/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:28.544025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6117081-98b2-4b45-b49a-9de4352a774b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:28.544586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6117081-98b2-4b45-b49a-9de4352a774b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:28.544778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6117081-98b2-4b45-b49a-9de4352a774b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:28.546540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 693/1383] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:28.551960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f883-ee64-4d13-bc05-4b6868ad7cb6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:28.552408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f883-ee64-4d13-bc05-4b6868ad7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:28.552503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0f883-ee64-4d13-bc05-4b6868ad7cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:28.621852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a8a0f883-ee64-4d13-bc05-4b6868ad7cb6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:28.623068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a8a0f883-ee64-4d13-bc05-4b6868ad7cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:28.725694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 691/1384] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:29.020289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6117081-98b2-4b45-b49a-9de4352a774b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:29.021886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c6117081-98b2-4b45-b49a-9de4352a774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:29.184638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6117081-98b2-4b45-b49a-9de4352a774b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:29.258288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:29.311045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669a2cf-6e6c-4ddc-84a9-b4f45e713a92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:29.311830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a2cf-6e6c-4ddc-84a9-b4f45e713a92 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:29.312208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a2cf-6e6c-4ddc-84a9-b4f45e713a92 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:29.312575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669a2cf-6e6c-4ddc-84a9-b4f45e713a92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:29.314733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b669a2cf-6e6c-4ddc-84a9-b4f45e713a92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:29.431227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669a2cf-6e6c-4ddc-84a9-b4f45e713a92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:29.433418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669a2cf-6e6c-4ddc-84a9-b4f45e713a92 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:29.455879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 694/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:31.441970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d9e9-c413-4731-b97c-b45e4b96c97b None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:31.442505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d9e9-c413-4731-b97c-b45e4b96c97b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:31.442505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0d9e9-c413-4731-b97c-b45e4b96c97b None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:31.443807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 692/1386] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 05:06:31.451124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088bfd0-4497-4e02-a6aa-a62b62a9aa24 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:31.451583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088bfd0-4497-4e02-a6aa-a62b62a9aa24 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:31.451844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088bfd0-4497-4e02-a6aa-a62b62a9aa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:31.523298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-c088bfd0-4497-4e02-a6aa-a62b62a9aa24 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:31.525669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c088bfd0-4497-4e02-a6aa-a62b62a9aa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:31.559974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:31.628427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 695/1387] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:31.927575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d9e9-c413-4731-b97c-b45e4b96c97b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:31.929117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b7e0d9e9-c413-4731-b97c-b45e4b96c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:32.023320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:32.114670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0d9e9-c413-4731-b97c-b45e4b96c97b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:32.359112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e9989-8fc7-4a94-8ff1-eedad23af062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:32.359112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e9989-8fc7-4a94-8ff1-eedad23af062 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:32.359112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e9989-8fc7-4a94-8ff1-eedad23af062 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:32.359112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e9989-8fc7-4a94-8ff1-eedad23af062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:32.359712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2e3e9989-8fc7-4a94-8ff1-eedad23af062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:32.359712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:32.408570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e9989-8fc7-4a94-8ff1-eedad23af062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:32.474794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e9989-8fc7-4a94-8ff1-eedad23af062 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:32.474794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 693/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:34.544762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166e1c-7911-47db-880b-3af7acb81aef None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:34.545346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166e1c-7911-47db-880b-3af7acb81aef None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:34.545346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166e1c-7911-47db-880b-3af7acb81aef None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:34.546728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 696/1389] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:34.552121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b18b6-394c-47be-8c6b-66f43125d09a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:34.552538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b18b6-394c-47be-8c6b-66f43125d09a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:34.552669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b18b6-394c-47be-8c6b-66f43125d09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:34.620123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-276b18b6-394c-47be-8c6b-66f43125d09a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:34.621343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-276b18b6-394c-47be-8c6b-66f43125d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:34.665521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691c8b1-339c-41d8-98aa-fabb356c74c4 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:34.665804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691c8b1-339c-41d8-98aa-fabb356c74c4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:34.666080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691c8b1-339c-41d8-98aa-fabb356c74c4 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:34.667498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 697/1390] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 05:06:34.672535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad724d9c-5840-4811-adf7-f7931566606a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:34.672813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad724d9c-5840-4811-adf7-f7931566606a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:34.673095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad724d9c-5840-4811-adf7-f7931566606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:34.723849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 694/1391] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:34.741510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ad724d9c-5840-4811-adf7-f7931566606a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:34.743327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ad724d9c-5840-4811-adf7-f7931566606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:34.840860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 698/1392] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:06:35.028853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f858c-6a79-4297-8149-b9abc86b1918 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:35.029137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f858c-6a79-4297-8149-b9abc86b1918 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:35.029413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f858c-6a79-4297-8149-b9abc86b1918 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:35.030889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 695/1393] 10.222.0.45 () {54 vars in 967 bytes} [Thu Aug 25 05:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:35.035984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b53e-2260-4a2c-96f9-b26fa0b4ff9f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:35.036272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b53e-2260-4a2c-96f9-b26fa0b4ff9f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:35.036545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b53e-2260-4a2c-96f9-b26fa0b4ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:35.052776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:35.114814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1790b53e-2260-4a2c-96f9-b26fa0b4ff9f None None] MFA Rules not processed for user `1ce4f6719f9b47dda69cc67ed74b45f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:35.115964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1790b53e-2260-4a2c-96f9-b26fa0b4ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:35.140941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f858c-6a79-4297-8149-b9abc86b1918 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:35.142631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-695f858c-6a79-4297-8149-b9abc86b1918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:35.160298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:35.208080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 699/1394] 10.222.0.45 () {58 vars in 1064 bytes} [Thu Aug 25 05:06:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:06:35.217615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b53e-2260-4a2c-96f9-b26fa0b4ff9f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:35.226255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b53e-2260-4a2c-96f9-b26fa0b4ff9f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:35.313359 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5374d-fa49-42e4-94d6-e69678cd8fe9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:35.313983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5374d-fa49-42e4-94d6-e69678cd8fe9 service glance] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:35.314263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5374d-fa49-42e4-94d6-e69678cd8fe9 service glance] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:35.314539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5374d-fa49-42e4-94d6-e69678cd8fe9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:35.316222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3fe5374d-fa49-42e4-94d6-e69678cd8fe9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:35.317003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f858c-6a79-4297-8149-b9abc86b1918 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:35.350539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:35.423551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:35.458153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c912dbf-a1aa-40d3-8b2e-e56e38ac5bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:35.458799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912dbf-a1aa-40d3-8b2e-e56e38ac5bab service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:35.459316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912dbf-a1aa-40d3-8b2e-e56e38ac5bab service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:35.459596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912dbf-a1aa-40d3-8b2e-e56e38ac5bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:35.463326 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4c912dbf-a1aa-40d3-8b2e-e56e38ac5bab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:35.464980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5374d-fa49-42e4-94d6-e69678cd8fe9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:35.465864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5374d-fa49-42e4-94d6-e69678cd8fe9 service glance] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:35.485017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 700/1395] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:35.556715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c912dbf-a1aa-40d3-8b2e-e56e38ac5bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:35.558380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c912dbf-a1aa-40d3-8b2e-e56e38ac5bab service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:35.577026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 696/1396] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:36.374787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2033afb-7241-40f5-95b1-a02cf9f27fa2 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:36.375288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2033afb-7241-40f5-95b1-a02cf9f27fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:36.375407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2033afb-7241-40f5-95b1-a02cf9f27fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:36.440843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a2033afb-7241-40f5-95b1-a02cf9f27fa2 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:36.442059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a2033afb-7241-40f5-95b1-a02cf9f27fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:36.531525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:36.537428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 701/1397] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:06:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:36.585064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18af5af-f516-4ecc-8ed8-92f355a7f698 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:36.585519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18af5af-f516-4ecc-8ed8-92f355a7f698 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:36.585731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18af5af-f516-4ecc-8ed8-92f355a7f698 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:36.587126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 697/1398] 10.222.0.45 () {54 vars in 943 bytes} [Thu Aug 25 05:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:36.593328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976f57f-e777-4f82-944f-cac48d39679b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:36.593612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976f57f-e777-4f82-944f-cac48d39679b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:36.593880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976f57f-e777-4f82-944f-cac48d39679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:36.670713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2976f57f-e777-4f82-944f-cac48d39679b None None] MFA Rules not processed for user `3101f5b8db404c0893687ad8cc51bb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:36.671833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2976f57f-e777-4f82-944f-cac48d39679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:36.785722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 702/1399] 10.222.0.45 () {58 vars in 1040 bytes} [Thu Aug 25 05:06:36 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:36.795551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18af5af-f516-4ecc-8ed8-92f355a7f698 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:36.797124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d18af5af-f516-4ecc-8ed8-92f355a7f698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:36.896652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:36.938502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18af5af-f516-4ecc-8ed8-92f355a7f698 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:37.041245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83008f1-92c5-4905-9d45-f8e5dfe3d9a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:37.041855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83008f1-92c5-4905-9d45-f8e5dfe3d9a8 service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:37.042134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83008f1-92c5-4905-9d45-f8e5dfe3d9a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:37.042407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83008f1-92c5-4905-9d45-f8e5dfe3d9a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:37.044070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b83008f1-92c5-4905-9d45-f8e5dfe3d9a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:37.129674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83008f1-92c5-4905-9d45-f8e5dfe3d9a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:37.131293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83008f1-92c5-4905-9d45-f8e5dfe3d9a8 service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:37.134935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:37.140449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 698/1400] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:06:37.637924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588e520-deda-4116-a269-a8b87a3ac1dd None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:37.638472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588e520-deda-4116-a269-a8b87a3ac1dd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:37.638472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588e520-deda-4116-a269-a8b87a3ac1dd None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:37.639747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 703/1401] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:37.644962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3884fc8-3f23-4ea4-a279-24d4ec44a698 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:37.645342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3884fc8-3f23-4ea4-a279-24d4ec44a698 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:37.645552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3884fc8-3f23-4ea4-a279-24d4ec44a698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:37.716561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b3884fc8-3f23-4ea4-a279-24d4ec44a698 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:37.717809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b3884fc8-3f23-4ea4-a279-24d4ec44a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:37.845703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 699/1402] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:38.147324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588e520-deda-4116-a269-a8b87a3ac1dd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:38.149260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d588e520-deda-4116-a269-a8b87a3ac1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:38.219600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:38.314936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588e520-deda-4116-a269-a8b87a3ac1dd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:38.432657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34532b5-6dcf-4a75-a952-6887ebfc7917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:38.433266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34532b5-6dcf-4a75-a952-6887ebfc7917 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:38.433547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34532b5-6dcf-4a75-a952-6887ebfc7917 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:38.433820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34532b5-6dcf-4a75-a952-6887ebfc7917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:38.435426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e34532b5-6dcf-4a75-a952-6887ebfc7917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:38.452380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:38.543081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34532b5-6dcf-4a75-a952-6887ebfc7917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:38.544987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34532b5-6dcf-4a75-a952-6887ebfc7917 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:38.568679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 704/1403] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:40.686513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76fe82-2264-4212-a80f-dfa3ab4475cd None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:40.687033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76fe82-2264-4212-a80f-dfa3ab4475cd None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:40.687033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76fe82-2264-4212-a80f-dfa3ab4475cd None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:40.688438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 700/1404] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:40.693812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb59d2-c38d-4e3c-81fe-f666012f8947 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:40.694235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb59d2-c38d-4e3c-81fe-f666012f8947 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:40.694235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb59d2-c38d-4e3c-81fe-f666012f8947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:40.778448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-54eb59d2-c38d-4e3c-81fe-f666012f8947 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:40.779777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-54eb59d2-c38d-4e3c-81fe-f666012f8947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:40.889271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:40.900209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 705/1405] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:41.210500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76fe82-2264-4212-a80f-dfa3ab4475cd None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:41.214745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6c76fe82-2264-4212-a80f-dfa3ab4475cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:41.308165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:41.390767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76fe82-2264-4212-a80f-dfa3ab4475cd None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:41.525542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5dc13-6e99-44bb-9e19-ed706bf2d54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:41.526169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5dc13-6e99-44bb-9e19-ed706bf2d54a service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:41.526449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5dc13-6e99-44bb-9e19-ed706bf2d54a service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:41.526720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5dc13-6e99-44bb-9e19-ed706bf2d54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:41.528436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-acf5dc13-6e99-44bb-9e19-ed706bf2d54a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:41.572974 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:41.635400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5dc13-6e99-44bb-9e19-ed706bf2d54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:41.637158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5dc13-6e99-44bb-9e19-ed706bf2d54a service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:41.663125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 701/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:43.842908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e07ab-d286-4a29-9e9a-e1a2d39d9c25 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:43.843524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e07ab-d286-4a29-9e9a-e1a2d39d9c25 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:43.843524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e07ab-d286-4a29-9e9a-e1a2d39d9c25 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:43.845144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 706/1407] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:06:43.850131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861e76-b380-4ec8-96e0-03f9fb937f99 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:43.850563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861e76-b380-4ec8-96e0-03f9fb937f99 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:43.850667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29861e76-b380-4ec8-96e0-03f9fb937f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:43.925336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-29861e76-b380-4ec8-96e0-03f9fb937f99 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:06:43.926556 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-29861e76-b380-4ec8-96e0-03f9fb937f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:44.052134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 702/1408] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:06:44.334554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e07ab-d286-4a29-9e9a-e1a2d39d9c25 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:06:44.336362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-596e07ab-d286-4a29-9e9a-e1a2d39d9c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:44.499273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e07ab-d286-4a29-9e9a-e1a2d39d9c25 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:06:44.582697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:44.640066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd75e9-b482-41a2-82ab-f03d02baace7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:06:44.640978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd75e9-b482-41a2-82ab-f03d02baace7 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:06:44.641257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd75e9-b482-41a2-82ab-f03d02baace7 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:06:44.641527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd75e9-b482-41a2-82ab-f03d02baace7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:06:44.643150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7acd75e9-b482-41a2-82ab-f03d02baace7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:06:44.751260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd75e9-b482-41a2-82ab-f03d02baace7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:06:44.752930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd75e9-b482-41a2-82ab-f03d02baace7 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:06:44.774705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 707/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:54.035809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=93 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:54.771109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=65 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:01.645605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad8c8-291a-47df-9434-71833dd33bb4 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:01.646204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad8c8-291a-47df-9434-71833dd33bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:01.646204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad8c8-291a-47df-9434-71833dd33bb4 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:01.648222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 703/1410] 10.222.0.45 () {54 vars in 918 bytes} [Thu Aug 25 05:07:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:01.653957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd532-c979-4574-97b4-b99c58316cf9 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:01.654368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd532-c979-4574-97b4-b99c58316cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:01.654510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd532-c979-4574-97b4-b99c58316cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:01.730937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-340bd532-c979-4574-97b4-b99c58316cf9 None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:01.732442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-340bd532-c979-4574-97b4-b99c58316cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:01.838577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 708/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Aug 25 05:07:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:01.852749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220b6e0-47f6-477c-b08c-f411f7a53869 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:01.853039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220b6e0-47f6-477c-b08c-f411f7a53869 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:01.853318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220b6e0-47f6-477c-b08c-f411f7a53869 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:01.854647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 704/1412] 10.222.0.45 () {54 vars in 918 bytes} [Thu Aug 25 05:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 05:07:01.859573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3a78e-aa08-4ffa-a87d-b061857b5871 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:01.859863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3a78e-aa08-4ffa-a87d-b061857b5871 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:01.860176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3a78e-aa08-4ffa-a87d-b061857b5871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:01.937718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:01.941206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-35e3a78e-aa08-4ffa-a87d-b061857b5871 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:01.942579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-35e3a78e-aa08-4ffa-a87d-b061857b5871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:02.057717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 709/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Aug 25 05:07:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:04.452246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4ded9-97bc-4100-807d-afd556c87db3 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:04.452898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4ded9-97bc-4100-807d-afd556c87db3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:04.452898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4ded9-97bc-4100-807d-afd556c87db3 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:04.454116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:04.459424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a27d3-c639-48e1-93a5-993144111c8b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:04.459829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a27d3-c639-48e1-93a5-993144111c8b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:04.460613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a27d3-c639-48e1-93a5-993144111c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:04.525545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d08a27d3-c639-48e1-93a5-993144111c8b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:04.526745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d08a27d3-c639-48e1-93a5-993144111c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:04.580033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:04.621512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:04.909161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4ded9-97bc-4100-807d-afd556c87db3 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:04.910694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8ab4ded9-97bc-4100-807d-afd556c87db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:05.057970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4ded9-97bc-4100-807d-afd556c87db3 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:05.128790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:05.169150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9a7f8-cf24-4d2e-8d53-ff58bcfba8e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:05.169682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a7f8-cf24-4d2e-8d53-ff58bcfba8e1 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:05.169960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a7f8-cf24-4d2e-8d53-ff58bcfba8e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:05.170232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a7f8-cf24-4d2e-8d53-ff58bcfba8e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:05.171841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e5e9a7f8-cf24-4d2e-8d53-ff58bcfba8e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:05.264088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9a7f8-cf24-4d2e-8d53-ff58bcfba8e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:05.265730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9a7f8-cf24-4d2e-8d53-ff58bcfba8e1 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:05.284122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 706/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:06.175606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142559a-a106-41e3-8d92-cf99436561c4 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:06.176162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142559a-a106-41e3-8d92-cf99436561c4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:06.176285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142559a-a106-41e3-8d92-cf99436561c4 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:06.177545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:06.183237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97c87-3008-49f4-8a46-0e0b776905f1 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:06.183669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97c87-3008-49f4-8a46-0e0b776905f1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:06.183771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97c87-3008-49f4-8a46-0e0b776905f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:06.260085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2cc97c87-3008-49f4-8a46-0e0b776905f1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:06.261306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2cc97c87-3008-49f4-8a46-0e0b776905f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:06.288020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:06.358143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:06.508349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142559a-a106-41e3-8d92-cf99436561c4 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:06.509919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3142559a-a106-41e3-8d92-cf99436561c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:06.654102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142559a-a106-41e3-8d92-cf99436561c4 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:06.694723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:06.768465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d44cb9-2b2c-4395-b90e-9c7fbb169216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:06.768985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44cb9-2b2c-4395-b90e-9c7fbb169216 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:06.769256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44cb9-2b2c-4395-b90e-9c7fbb169216 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:06.769519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d44cb9-2b2c-4395-b90e-9c7fbb169216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:06.771105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-23d44cb9-2b2c-4395-b90e-9c7fbb169216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:06.859920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d44cb9-2b2c-4395-b90e-9c7fbb169216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:06.861517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d44cb9-2b2c-4395-b90e-9c7fbb169216 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:06.879609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 712/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:07.759426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf31c-18a3-4600-979d-da80b4cebb47 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:07.759967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf31c-18a3-4600-979d-da80b4cebb47 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:07.760065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf31c-18a3-4600-979d-da80b4cebb47 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:07.761367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:07.766228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510052-b381-497c-9f0f-302faa8b4167 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:07.766631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510052-b381-497c-9f0f-302faa8b4167 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:07.766778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510052-b381-497c-9f0f-302faa8b4167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:07.821155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:07.842287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-bc510052-b381-497c-9f0f-302faa8b4167 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:07.843499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bc510052-b381-497c-9f0f-302faa8b4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:07.939790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:08.102783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf31c-18a3-4600-979d-da80b4cebb47 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:08.104427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5eaaf31c-18a3-4600-979d-da80b4cebb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:08.248636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf31c-18a3-4600-979d-da80b4cebb47 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:08.261049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:08.361427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3e216-e49e-4b3e-a11e-c939f6259cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:08.361951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e216-e49e-4b3e-a11e-c939f6259cf1 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:08.362229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e216-e49e-4b3e-a11e-c939f6259cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:08.362497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e216-e49e-4b3e-a11e-c939f6259cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:08.364136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-17b3e216-e49e-4b3e-a11e-c939f6259cf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:08.454007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3e216-e49e-4b3e-a11e-c939f6259cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:08.455605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3e216-e49e-4b3e-a11e-c939f6259cf1 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:08.473272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 709/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:09.391855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5658-120e-42d7-b381-79df4967d049 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:09.392452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5658-120e-42d7-b381-79df4967d049 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:09.392784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f5658-120e-42d7-b381-79df4967d049 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:09.394245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:09.400936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f27c-2095-4628-8af6-8cf04467f823 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:09.401444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f27c-2095-4628-8af6-8cf04467f823 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:09.401812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f27c-2095-4628-8af6-8cf04467f823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:09.426129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:09.494221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6e34f27c-2095-4628-8af6-8cf04467f823 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:09.495448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6e34f27c-2095-4628-8af6-8cf04467f823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:09.592461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:09.741443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5658-120e-42d7-b381-79df4967d049 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:09.743071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-cb7f5658-120e-42d7-b381-79df4967d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:09.859422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:09.895366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f5658-120e-42d7-b381-79df4967d049 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:10.011527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354299-d023-4c35-9f7e-1bf08b8d0fca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:10.012162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354299-d023-4c35-9f7e-1bf08b8d0fca service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:10.012435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354299-d023-4c35-9f7e-1bf08b8d0fca service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:10.012702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354299-d023-4c35-9f7e-1bf08b8d0fca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:10.014339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d6354299-d023-4c35-9f7e-1bf08b8d0fca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:10.090138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:10.103420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354299-d023-4c35-9f7e-1bf08b8d0fca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:10.110347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354299-d023-4c35-9f7e-1bf08b8d0fca service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:10.123724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 715/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:07:10.991969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3be712-4697-4209-978f-64932f661d74 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:10.992527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3be712-4697-4209-978f-64932f661d74 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:10.992527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3be712-4697-4209-978f-64932f661d74 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:10.993858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:10.998813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217e037-f987-4aa7-bd2e-55c25960670b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:10.999234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217e037-f987-4aa7-bd2e-55c25960670b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:10.999352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217e037-f987-4aa7-bd2e-55c25960670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:11.073719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3217e037-f987-4aa7-bd2e-55c25960670b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:11.074928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3217e037-f987-4aa7-bd2e-55c25960670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:11.182608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:11.334389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3be712-4697-4209-978f-64932f661d74 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:11.336101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1c3be712-4697-4209-978f-64932f661d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:11.420823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:11.495039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3be712-4697-4209-978f-64932f661d74 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:11.606360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841b575-a84a-4049-a322-d1b2d5e1decb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:11.607136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b575-a84a-4049-a322-d1b2d5e1decb service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:11.607411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b575-a84a-4049-a322-d1b2d5e1decb service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:11.607677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841b575-a84a-4049-a322-d1b2d5e1decb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:11.609294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d841b575-a84a-4049-a322-d1b2d5e1decb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:11.656296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:11.697824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841b575-a84a-4049-a322-d1b2d5e1decb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:11.699442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841b575-a84a-4049-a322-d1b2d5e1decb service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:11.718200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 712/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:12.576201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5d61-bb7d-4637-81e5-89e42939e67e None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:12.576735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5d61-bb7d-4637-81e5-89e42939e67e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:12.576735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e5d61-bb7d-4637-81e5-89e42939e67e None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:12.578027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:12.582964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53fc1-2cac-405c-b495-f8f770140c39 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:12.583383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53fc1-2cac-405c-b495-f8f770140c39 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:12.583489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53fc1-2cac-405c-b495-f8f770140c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:12.659138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3dd53fc1-2cac-405c-b495-f8f770140c39 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:12.660376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3dd53fc1-2cac-405c-b495-f8f770140c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:12.758485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:12.909671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5d61-bb7d-4637-81e5-89e42939e67e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:12.911191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-479e5d61-bb7d-4637-81e5-89e42939e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:12.962203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:13.059351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e5d61-bb7d-4637-81e5-89e42939e67e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:13.173835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec7fbc-171a-4e2b-9551-7f3cb467081b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:13.174368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec7fbc-171a-4e2b-9551-7f3cb467081b service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:13.174648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec7fbc-171a-4e2b-9551-7f3cb467081b service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:13.174922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec7fbc-171a-4e2b-9551-7f3cb467081b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:13.176565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9fec7fbc-171a-4e2b-9551-7f3cb467081b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:13.184587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:13.267224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec7fbc-171a-4e2b-9551-7f3cb467081b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:13.268867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec7fbc-171a-4e2b-9551-7f3cb467081b service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:13.287315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 718/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:14.157734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640db17-92aa-48c0-a4a0-bfaebe148948 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:14.158394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640db17-92aa-48c0-a4a0-bfaebe148948 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:14.158394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640db17-92aa-48c0-a4a0-bfaebe148948 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:14.159687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:14.165579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b6110-c611-4e11-b669-3b7bb87ee523 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:14.166055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b6110-c611-4e11-b669-3b7bb87ee523 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:14.166204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b6110-c611-4e11-b669-3b7bb87ee523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:14.243078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b37b6110-c611-4e11-b669-3b7bb87ee523 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:14.244385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b37b6110-c611-4e11-b669-3b7bb87ee523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:14.312352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:14.340520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:14.490424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640db17-92aa-48c0-a4a0-bfaebe148948 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:14.492109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4640db17-92aa-48c0-a4a0-bfaebe148948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:14.509301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:14.636927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640db17-92aa-48c0-a4a0-bfaebe148948 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:14.722948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:14.748904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3dd20-653e-4d9f-9907-61cf1b045d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:14.749452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3dd20-653e-4d9f-9907-61cf1b045d27 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:14.749724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3dd20-653e-4d9f-9907-61cf1b045d27 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:14.749992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3dd20-653e-4d9f-9907-61cf1b045d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:14.751647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-45b3dd20-653e-4d9f-9907-61cf1b045d27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:14.840966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3dd20-653e-4d9f-9907-61cf1b045d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:14.842630 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3dd20-653e-4d9f-9907-61cf1b045d27 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:14.861169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 715/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:15.759311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c53eb-9bc6-407f-bcde-0d3d21ca8d87 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:15.759861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c53eb-9bc6-407f-bcde-0d3d21ca8d87 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:15.759861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c53eb-9bc6-407f-bcde-0d3d21ca8d87 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:15.762019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:15.767078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe188e-fb64-4315-91ea-2abaa96db9f3 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:15.767512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe188e-fb64-4315-91ea-2abaa96db9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:15.767613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe188e-fb64-4315-91ea-2abaa96db9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:15.846152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-efbe188e-fb64-4315-91ea-2abaa96db9f3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:15.847372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-efbe188e-fb64-4315-91ea-2abaa96db9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:15.889186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:15.942207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:16.093278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c53eb-9bc6-407f-bcde-0d3d21ca8d87 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:16.094807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5e6c53eb-9bc6-407f-bcde-0d3d21ca8d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:16.241386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c53eb-9bc6-407f-bcde-0d3d21ca8d87 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:16.296298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:16.356108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5720e74-28fe-48d8-b9dd-76be9fc04bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:16.356635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5720e74-28fe-48d8-b9dd-76be9fc04bcd service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:16.357165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5720e74-28fe-48d8-b9dd-76be9fc04bcd service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:16.357430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5720e74-28fe-48d8-b9dd-76be9fc04bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:16.359012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a5720e74-28fe-48d8-b9dd-76be9fc04bcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:16.446034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5720e74-28fe-48d8-b9dd-76be9fc04bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:16.447637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5720e74-28fe-48d8-b9dd-76be9fc04bcd service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:16.466093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 721/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:17.336852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db708ceb-912f-4b33-9aff-59b408ab512c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:17.337445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db708ceb-912f-4b33-9aff-59b408ab512c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:17.337445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db708ceb-912f-4b33-9aff-59b408ab512c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:17.338747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:17.343737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ce57-cac4-47d5-ab6b-f1d9656e46bc None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:17.344205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ce57-cac4-47d5-ab6b-f1d9656e46bc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:17.344348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036ce57-cac4-47d5-ab6b-f1d9656e46bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:17.420348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8036ce57-cac4-47d5-ab6b-f1d9656e46bc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:17.421567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8036ce57-cac4-47d5-ab6b-f1d9656e46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:17.423592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:17.517659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:17.669500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db708ceb-912f-4b33-9aff-59b408ab512c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:17.670973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-db708ceb-912f-4b33-9aff-59b408ab512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:17.816670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db708ceb-912f-4b33-9aff-59b408ab512c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:17.846801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:17.933299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a700d-6ffa-4314-88d7-17804b4dbbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:17.933830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a700d-6ffa-4314-88d7-17804b4dbbc7 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:17.934109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a700d-6ffa-4314-88d7-17804b4dbbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:17.934379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a700d-6ffa-4314-88d7-17804b4dbbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:17.936007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6b5a700d-6ffa-4314-88d7-17804b4dbbc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:18.024982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a700d-6ffa-4314-88d7-17804b4dbbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:18.026609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a700d-6ffa-4314-88d7-17804b4dbbc7 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:18.046107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 718/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:19.873795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1380-c740-4369-b01a-8cf58a05e409 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:19.874346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1380-c740-4369-b01a-8cf58a05e409 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:19.874442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1380-c740-4369-b01a-8cf58a05e409 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:19.875752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:19.881267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3451e2-79d2-4ff2-8d1b-46d060085102 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:19.881696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3451e2-79d2-4ff2-8d1b-46d060085102 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:19.881818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3451e2-79d2-4ff2-8d1b-46d060085102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:19.923011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:19.947637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-fe3451e2-79d2-4ff2-8d1b-46d060085102 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:19.948885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fe3451e2-79d2-4ff2-8d1b-46d060085102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:20.046859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:20.332928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1380-c740-4369-b01a-8cf58a05e409 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:20.334645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-675d1380-c740-4369-b01a-8cf58a05e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:20.446042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1380-c740-4369-b01a-8cf58a05e409 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:20.478989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:20.521271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838736c1-6e45-4865-9290-93a4e29f2928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:20.522402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838736c1-6e45-4865-9290-93a4e29f2928 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:20.522676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838736c1-6e45-4865-9290-93a4e29f2928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:20.522957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838736c1-6e45-4865-9290-93a4e29f2928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:20.524585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-838736c1-6e45-4865-9290-93a4e29f2928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:20.632965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838736c1-6e45-4865-9290-93a4e29f2928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:20.634328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838736c1-6e45-4865-9290-93a4e29f2928 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:20.653019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 724/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:22.722604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749171-5390-4c62-b3f7-211b50e56bbf None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:22.723051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749171-5390-4c62-b3f7-211b50e56bbf None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:22.723157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749171-5390-4c62-b3f7-211b50e56bbf None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:22.724541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:22.729852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805aa4-7906-4d7f-a15d-e613a25b961d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:22.730295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805aa4-7906-4d7f-a15d-e613a25b961d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:22.730426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df805aa4-7906-4d7f-a15d-e613a25b961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:22.798402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-df805aa4-7906-4d7f-a15d-e613a25b961d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:22.799608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-df805aa4-7906-4d7f-a15d-e613a25b961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:22.813009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:22.896601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:23.186135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0749171-5390-4c62-b3f7-211b50e56bbf None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:23.187683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a0749171-5390-4c62-b3f7-211b50e56bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:23.291787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0749171-5390-4c62-b3f7-211b50e56bbf None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:23.303971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:23.365382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97a715-fe2f-4367-85fc-133e5054fd81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:23.365926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a715-fe2f-4367-85fc-133e5054fd81 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:23.366199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a715-fe2f-4367-85fc-133e5054fd81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:23.366465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97a715-fe2f-4367-85fc-133e5054fd81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:23.368118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ed97a715-fe2f-4367-85fc-133e5054fd81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:23.475285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97a715-fe2f-4367-85fc-133e5054fd81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:23.476724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97a715-fe2f-4367-85fc-133e5054fd81 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:23.494890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 721/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:25.797461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb63314-7cb6-4fed-8a9c-3e4acec3c091 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:25.797989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb63314-7cb6-4fed-8a9c-3e4acec3c091 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:25.797989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb63314-7cb6-4fed-8a9c-3e4acec3c091 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:25.799382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:25.805056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29867d-46ee-43d7-acab-65d2ba1905d8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:25.805491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29867d-46ee-43d7-acab-65d2ba1905d8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:25.805644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29867d-46ee-43d7-acab-65d2ba1905d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:25.854157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:25.871784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cc29867d-46ee-43d7-acab-65d2ba1905d8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:25.873049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cc29867d-46ee-43d7-acab-65d2ba1905d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:25.969043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:26.261442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb63314-7cb6-4fed-8a9c-3e4acec3c091 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:26.263002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5eb63314-7cb6-4fed-8a9c-3e4acec3c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:26.367762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb63314-7cb6-4fed-8a9c-3e4acec3c091 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:26.408047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:26.441244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198a7b7-770a-4333-985b-e8776cf54fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:26.441841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a7b7-770a-4333-985b-e8776cf54fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:26.442115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a7b7-770a-4333-985b-e8776cf54fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:26.442383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198a7b7-770a-4333-985b-e8776cf54fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:26.444593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b198a7b7-770a-4333-985b-e8776cf54fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:26.563333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198a7b7-770a-4333-985b-e8776cf54fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:26.564743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198a7b7-770a-4333-985b-e8776cf54fd0 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:26.583588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 727/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:28.616630 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d690bf-1695-43c4-8b52-eb4d24c84e17 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:28.617193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d690bf-1695-43c4-8b52-eb4d24c84e17 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:28.617193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d690bf-1695-43c4-8b52-eb4d24c84e17 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:28.618525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:28.623753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53e7b-e16b-434d-b9f4-c44b32787a74 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:28.624184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53e7b-e16b-434d-b9f4-c44b32787a74 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:28.624329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d53e7b-e16b-434d-b9f4-c44b32787a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:28.689890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-49d53e7b-e16b-434d-b9f4-c44b32787a74 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:28.691099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-49d53e7b-e16b-434d-b9f4-c44b32787a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:28.712421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:28.788947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:07:29.073264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d690bf-1695-43c4-8b52-eb4d24c84e17 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:29.074871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c4d690bf-1695-43c4-8b52-eb4d24c84e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:29.181176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d690bf-1695-43c4-8b52-eb4d24c84e17 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:29.201365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:29.255464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6509c-af3e-4819-ad3b-fc0368e103d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:29.256466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6509c-af3e-4819-ad3b-fc0368e103d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:29.256745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6509c-af3e-4819-ad3b-fc0368e103d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:29.257017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6509c-af3e-4819-ad3b-fc0368e103d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:29.258651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-90f6509c-af3e-4819-ad3b-fc0368e103d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:29.370443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6509c-af3e-4819-ad3b-fc0368e103d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:29.371812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6509c-af3e-4819-ad3b-fc0368e103d2 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:29.389945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 724/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:31.351969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62aa4f-fd00-4cda-9bff-94336af8f3ac None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:31.352501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62aa4f-fd00-4cda-9bff-94336af8f3ac None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:31.352501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62aa4f-fd00-4cda-9bff-94336af8f3ac None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:31.353864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:31.359579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c5a66-07da-4bb5-9e06-04b4b0bce064 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:31.360013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c5a66-07da-4bb5-9e06-04b4b0bce064 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:31.360154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c5a66-07da-4bb5-9e06-04b4b0bce064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:31.424145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:31.426649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2d5c5a66-07da-4bb5-9e06-04b4b0bce064 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:31.428074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2d5c5a66-07da-4bb5-9e06-04b4b0bce064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:31.524707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:31.810066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62aa4f-fd00-4cda-9bff-94336af8f3ac None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:31.811614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0b62aa4f-fd00-4cda-9bff-94336af8f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:31.915432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62aa4f-fd00-4cda-9bff-94336af8f3ac None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:31.965285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:31.990315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135524b-1e96-42d7-9a06-e41454060a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:31.990923 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135524b-1e96-42d7-9a06-e41454060a57 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:31.991201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135524b-1e96-42d7-9a06-e41454060a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:31.992180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135524b-1e96-42d7-9a06-e41454060a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:31.993797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b135524b-1e96-42d7-9a06-e41454060a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:32.101323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135524b-1e96-42d7-9a06-e41454060a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:32.103124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135524b-1e96-42d7-9a06-e41454060a57 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:32.126795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 730/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:34.254940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71c39-10c6-4b7e-bc39-d505adde33f7 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:34.255476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71c39-10c6-4b7e-bc39-d505adde33f7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:34.255476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e71c39-10c6-4b7e-bc39-d505adde33f7 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:34.257500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:34.262983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d627f-8971-4b54-b16e-dfeeec99fbb9 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:34.263399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d627f-8971-4b54-b16e-dfeeec99fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:34.263527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d627f-8971-4b54-b16e-dfeeec99fbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:34.329470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-811d627f-8971-4b54-b16e-dfeeec99fbb9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:34.330717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-811d627f-8971-4b54-b16e-dfeeec99fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:34.360236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:34.427050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:34.720608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e71c39-10c6-4b7e-bc39-d505adde33f7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:34.722137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-72e71c39-10c6-4b7e-bc39-d505adde33f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:34.824472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e71c39-10c6-4b7e-bc39-d505adde33f7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:34.853774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:34.898402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d306-438c-44b8-bb5b-26a4a37740fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:34.899004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d306-438c-44b8-bb5b-26a4a37740fe service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:34.899281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d306-438c-44b8-bb5b-26a4a37740fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:34.899550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d306-438c-44b8-bb5b-26a4a37740fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:34.901176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7a87d306-438c-44b8-bb5b-26a4a37740fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:35.126626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d306-438c-44b8-bb5b-26a4a37740fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:35.128085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d306-438c-44b8-bb5b-26a4a37740fe service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:35.146013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 727/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:37.094894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea5ed9-1c85-450b-b88c-7d43ac15f033 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:37.095470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea5ed9-1c85-450b-b88c-7d43ac15f033 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:37.095470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea5ed9-1c85-450b-b88c-7d43ac15f033 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:37.096836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:37.102333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9b000-9629-4406-b6e8-3a1915b92481 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:37.102789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9b000-9629-4406-b6e8-3a1915b92481 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:37.102898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9b000-9629-4406-b6e8-3a1915b92481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:37.168806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-17e9b000-9629-4406-b6e8-3a1915b92481 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:37.170030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-17e9b000-9629-4406-b6e8-3a1915b92481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:37.178345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:37.266744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:37.552686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea5ed9-1c85-450b-b88c-7d43ac15f033 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:37.554356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-efea5ed9-1c85-450b-b88c-7d43ac15f033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:37.659257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea5ed9-1c85-450b-b88c-7d43ac15f033 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:37.716085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:37.734833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36868c-bd73-481a-888b-cb506f03f254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:37.735444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36868c-bd73-481a-888b-cb506f03f254 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:37.735728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36868c-bd73-481a-888b-cb506f03f254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:37.736037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36868c-bd73-481a-888b-cb506f03f254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:37.737652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2c36868c-bd73-481a-888b-cb506f03f254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:37.847800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36868c-bd73-481a-888b-cb506f03f254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:37.849202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36868c-bd73-481a-888b-cb506f03f254 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:37.868094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 733/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:39.840583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d2e7-ee23-4c96-9f81-7ad66e70b38c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:39.841105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d2e7-ee23-4c96-9f81-7ad66e70b38c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:39.841105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d2e7-ee23-4c96-9f81-7ad66e70b38c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:39.842467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:39.848103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c74881-12f9-46d0-91a6-3df7cb4c69ca None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:39.851651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c74881-12f9-46d0-91a6-3df7cb4c69ca None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:39.851651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c74881-12f9-46d0-91a6-3df7cb4c69ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:39.931512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-31c74881-12f9-46d0-91a6-3df7cb4c69ca None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:39.933008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-31c74881-12f9-46d0-91a6-3df7cb4c69ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:39.972696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:40.033288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:40.327461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d2e7-ee23-4c96-9f81-7ad66e70b38c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:40.329104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7ef8d2e7-ee23-4c96-9f81-7ad66e70b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:40.432374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d2e7-ee23-4c96-9f81-7ad66e70b38c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:40.468866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:40.505458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911e210-1f4d-4792-ad6c-4dafb47082b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:40.506066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911e210-1f4d-4792-ad6c-4dafb47082b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:40.506349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911e210-1f4d-4792-ad6c-4dafb47082b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:40.506749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911e210-1f4d-4792-ad6c-4dafb47082b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:40.516780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e911e210-1f4d-4792-ad6c-4dafb47082b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:40.628898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911e210-1f4d-4792-ad6c-4dafb47082b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:40.630379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911e210-1f4d-4792-ad6c-4dafb47082b2 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:40.648986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 730/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:42.583321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498a7a-cc6f-4353-a8a5-74120f11dcc5 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:42.583855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498a7a-cc6f-4353-a8a5-74120f11dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:42.583855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab498a7a-cc6f-4353-a8a5-74120f11dcc5 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:42.585351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:42.590691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60d0a-075f-4052-8a58-954c336d1f8b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:42.591115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60d0a-075f-4052-8a58-954c336d1f8b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:42.591231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60d0a-075f-4052-8a58-954c336d1f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:42.656475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-39a60d0a-075f-4052-8a58-954c336d1f8b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:42.657693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-39a60d0a-075f-4052-8a58-954c336d1f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:42.676095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:42.754696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:43.041424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab498a7a-cc6f-4353-a8a5-74120f11dcc5 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:43.042963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ab498a7a-cc6f-4353-a8a5-74120f11dcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:43.145337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab498a7a-cc6f-4353-a8a5-74120f11dcc5 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:43.210503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:43.217101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cdfcc-35c6-4038-bcd8-cacba1e8d7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:43.217722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cdfcc-35c6-4038-bcd8-cacba1e8d7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:43.217978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cdfcc-35c6-4038-bcd8-cacba1e8d7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:43.218246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cdfcc-35c6-4038-bcd8-cacba1e8d7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:43.219824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-941cdfcc-35c6-4038-bcd8-cacba1e8d7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:43.330256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cdfcc-35c6-4038-bcd8-cacba1e8d7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:43.331627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cdfcc-35c6-4038-bcd8-cacba1e8d7f2 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:43.350412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 736/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:45.264643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7327c54-7c8b-4c1b-bacc-a890a555bb5b None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:45.265212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7327c54-7c8b-4c1b-bacc-a890a555bb5b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:45.265212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7327c54-7c8b-4c1b-bacc-a890a555bb5b None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:45.266513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:07:45.271854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686dd30-24c3-4e4d-a303-953707da4cbc None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:45.272845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686dd30-24c3-4e4d-a303-953707da4cbc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:45.272953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686dd30-24c3-4e4d-a303-953707da4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:45.339042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-c686dd30-24c3-4e4d-a303-953707da4cbc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:07:45.340292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c686dd30-24c3-4e4d-a303-953707da4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:45.389872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:45.556209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:07:45.842734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7327c54-7c8b-4c1b-bacc-a890a555bb5b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:07:45.844307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b7327c54-7c8b-4c1b-bacc-a890a555bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:45.948625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7327c54-7c8b-4c1b-bacc-a890a555bb5b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:07:45.996539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:46.022639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43566605-cad3-4311-af6a-dbe604749a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:07:46.023376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43566605-cad3-4311-af6a-dbe604749a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:07:46.023657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43566605-cad3-4311-af6a-dbe604749a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:07:46.023943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43566605-cad3-4311-af6a-dbe604749a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:07:46.025561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-43566605-cad3-4311-af6a-dbe604749a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:07:46.132811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43566605-cad3-4311-af6a-dbe604749a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:07:46.134793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43566605-cad3-4311-af6a-dbe604749a8b service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:07:46.153311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 733/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:07:55.554398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=22 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:56.150918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=66 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:05.875121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87417-2fcd-4426-99cd-ecbc20dbdac7 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:05.875694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87417-2fcd-4426-99cd-ecbc20dbdac7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:05.875694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc87417-2fcd-4426-99cd-ecbc20dbdac7 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:05.877047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 738/1471] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:05.882423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88056077-4b39-49dc-8b83-37b101719e9b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:05.882873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88056077-4b39-49dc-8b83-37b101719e9b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:05.882989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88056077-4b39-49dc-8b83-37b101719e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:05.948090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-88056077-4b39-49dc-8b83-37b101719e9b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:05.949316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-88056077-4b39-49dc-8b83-37b101719e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:06.045882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 734/1472] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:08:06.350480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48f56f-5846-4624-831c-a560fcd36cfe None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:06.350756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48f56f-5846-4624-831c-a560fcd36cfe None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:06.351031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48f56f-5846-4624-831c-a560fcd36cfe None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:06.352401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 739/1473] 10.222.0.45 () {54 vars in 967 bytes} [Thu Aug 25 05:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:06.357516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef1fa-5a64-4958-99e9-5b3b8cd89492 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:06.357799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef1fa-5a64-4958-99e9-5b3b8cd89492 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:06.358094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fef1fa-5a64-4958-99e9-5b3b8cd89492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:06.432200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-72fef1fa-5a64-4958-99e9-5b3b8cd89492 None None] MFA Rules not processed for user `1ce4f6719f9b47dda69cc67ed74b45f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:06.433423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-72fef1fa-5a64-4958-99e9-5b3b8cd89492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:06.453226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:06.508985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 735/1474] 10.222.0.45 () {58 vars in 1064 bytes} [Thu Aug 25 05:08:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:08:06.516505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48f56f-5846-4624-831c-a560fcd36cfe None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:08:06.518012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0f48f56f-5846-4624-831c-a560fcd36cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:06.625892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48f56f-5846-4624-831c-a560fcd36cfe None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:08:06.699507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beeefa9-29d7-4059-b42d-1858808db7d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:08:06.700148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beeefa9-29d7-4059-b42d-1858808db7d6 service glance] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:06.700432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beeefa9-29d7-4059-b42d-1858808db7d6 service glance] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:06.700696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beeefa9-29d7-4059-b42d-1858808db7d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:06.702290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4beeefa9-29d7-4059-b42d-1858808db7d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:06.757304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:06.810951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beeefa9-29d7-4059-b42d-1858808db7d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:08:06.812421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beeefa9-29d7-4059-b42d-1858808db7d6 service glance] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:08:06.830976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 740/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:08:08.813866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447685-4b0e-400c-874d-2bd3f1aa6088 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:08.814439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447685-4b0e-400c-874d-2bd3f1aa6088 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:08.814439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32447685-4b0e-400c-874d-2bd3f1aa6088 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:08.815751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 736/1476] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:08.821551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b67f-6c36-4119-8d11-5736a4054330 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:08.821995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b67f-6c36-4119-8d11-5736a4054330 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:08.822092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4b67f-6c36-4119-8d11-5736a4054330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:08.888699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e8b4b67f-6c36-4119-8d11-5736a4054330 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:08.889830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e8b4b67f-6c36-4119-8d11-5736a4054330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:08.984871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 741/1477] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:08:09.262371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447685-4b0e-400c-874d-2bd3f1aa6088 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:08:09.263894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-32447685-4b0e-400c-874d-2bd3f1aa6088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:09.391755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32447685-4b0e-400c-874d-2bd3f1aa6088 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:08:09.441026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:09.486308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a5c25-de69-457a-8b7d-0965e551fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:08:09.486916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5c25-de69-457a-8b7d-0965e551fcba admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:09.487189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5c25-de69-457a-8b7d-0965e551fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:09.487453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a5c25-de69-457a-8b7d-0965e551fcba admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:09.488116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a5c25-de69-457a-8b7d-0965e551fcba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:08:09.490429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-bc7a5c25-de69-457a-8b7d-0965e551fcba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:08:09.490429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:08:09.490429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:08:09.491591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a5c25-de69-457a-8b7d-0965e551fcba admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:08:09.510489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 737/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Thu Aug 25 05:08:09 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:08:11.447813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eea71-be3b-4c1b-96a3-3b172e70e83b None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:11.448417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eea71-be3b-4c1b-96a3-3b172e70e83b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:11.448417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eea71-be3b-4c1b-96a3-3b172e70e83b None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:11.449733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 742/1479] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:11.454914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5b84-cc5e-4288-8b4f-b7a6e0c6aba6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:11.455361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5b84-cc5e-4288-8b4f-b7a6e0c6aba6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:11.455471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5b84-cc5e-4288-8b4f-b7a6e0c6aba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:11.520849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c75a5b84-cc5e-4288-8b4f-b7a6e0c6aba6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:11.522732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c75a5b84-cc5e-4288-8b4f-b7a6e0c6aba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:11.619512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 738/1480] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:08:11.917127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eea71-be3b-4c1b-96a3-3b172e70e83b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:08:11.918655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e32eea71-be3b-4c1b-96a3-3b172e70e83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:11.929265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:12.065529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eea71-be3b-4c1b-96a3-3b172e70e83b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:08:12.147817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:12.179972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabae51-a302-4382-a9a8-0a24a99f9b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:08:12.180586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabae51-a302-4382-a9a8-0a24a99f9b43 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:12.180854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabae51-a302-4382-a9a8-0a24a99f9b43 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:12.181125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabae51-a302-4382-a9a8-0a24a99f9b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:12.182721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ffabae51-a302-4382-a9a8-0a24a99f9b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:12.273871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabae51-a302-4382-a9a8-0a24a99f9b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:08:12.275474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabae51-a302-4382-a9a8-0a24a99f9b43 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:08:12.294671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 743/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:08:14.405532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430fac3-171a-499f-b199-7ca39e50fe82 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:14.406078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430fac3-171a-499f-b199-7ca39e50fe82 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:14.406078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430fac3-171a-499f-b199-7ca39e50fe82 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:14.407422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 739/1482] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:14.413311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936c2f-7fbb-4561-9b67-7f075e576d12 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:14.413761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936c2f-7fbb-4561-9b67-7f075e576d12 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:14.413869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936c2f-7fbb-4561-9b67-7f075e576d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:14.479374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ec936c2f-7fbb-4561-9b67-7f075e576d12 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:14.480605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ec936c2f-7fbb-4561-9b67-7f075e576d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:14.527237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:14.576925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 744/1483] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:08:14.863202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430fac3-171a-499f-b199-7ca39e50fe82 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:08:14.865492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2430fac3-171a-499f-b199-7ca39e50fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:14.888601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:14.965942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430fac3-171a-499f-b199-7ca39e50fe82 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:08:15.037164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13c3a1-2e2b-4a79-9e5c-996d334b7e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:08:15.037764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13c3a1-2e2b-4a79-9e5c-996d334b7e8c service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:15.038041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13c3a1-2e2b-4a79-9e5c-996d334b7e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:15.038316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13c3a1-2e2b-4a79-9e5c-996d334b7e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:15.039888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ca13c3a1-2e2b-4a79-9e5c-996d334b7e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:15.113335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:15.148189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13c3a1-2e2b-4a79-9e5c-996d334b7e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:08:15.149656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13c3a1-2e2b-4a79-9e5c-996d334b7e8c service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:08:15.167391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 740/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:08:17.160378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c928c3-9f35-42be-859d-95f7135111fa None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:17.160980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c928c3-9f35-42be-859d-95f7135111fa None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:17.160980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c928c3-9f35-42be-859d-95f7135111fa None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:17.162537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 745/1485] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:17.167775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944305-2370-4356-9a1a-a0fb6727357f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:17.168226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944305-2370-4356-9a1a-a0fb6727357f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:17.168353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64944305-2370-4356-9a1a-a0fb6727357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:17.233744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-64944305-2370-4356-9a1a-a0fb6727357f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:17.235044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-64944305-2370-4356-9a1a-a0fb6727357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:17.331844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 741/1486] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:08:17.619424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c928c3-9f35-42be-859d-95f7135111fa None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:08:17.620987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f1c928c3-9f35-42be-859d-95f7135111fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:17.725970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c928c3-9f35-42be-859d-95f7135111fa None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:08:17.796796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:17.798544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51255f-a22b-438a-bda3-3a9e9f26bea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:08:17.799144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51255f-a22b-438a-bda3-3a9e9f26bea6 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:17.799421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51255f-a22b-438a-bda3-3a9e9f26bea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:17.799705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51255f-a22b-438a-bda3-3a9e9f26bea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:17.801317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-eb51255f-a22b-438a-bda3-3a9e9f26bea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:17.908593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51255f-a22b-438a-bda3-3a9e9f26bea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:08:17.909958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51255f-a22b-438a-bda3-3a9e9f26bea6 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:08:17.928918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 746/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:08:19.930782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7468ada-c71e-4cb0-b5d4-12396bbf8a30 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:19.931333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7468ada-c71e-4cb0-b5d4-12396bbf8a30 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:19.931333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7468ada-c71e-4cb0-b5d4-12396bbf8a30 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:19.932803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 742/1488] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:19.938117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651833a4-8e9e-407d-865c-b6d052f5c8d0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:19.938522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651833a4-8e9e-407d-865c-b6d052f5c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:19.938670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651833a4-8e9e-407d-865c-b6d052f5c8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:20.004511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-651833a4-8e9e-407d-865c-b6d052f5c8d0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:20.006237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-651833a4-8e9e-407d-865c-b6d052f5c8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:20.057981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:20.102399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 747/1489] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:08:20.394724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7468ada-c71e-4cb0-b5d4-12396bbf8a30 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:08:20.396296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a7468ada-c71e-4cb0-b5d4-12396bbf8a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:20.436733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:20.503177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7468ada-c71e-4cb0-b5d4-12396bbf8a30 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:08:20.574256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f2249-cf84-4123-97cf-f0e8279e1017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:08:20.574853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2249-cf84-4123-97cf-f0e8279e1017 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:20.575124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2249-cf84-4123-97cf-f0e8279e1017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:20.575388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f2249-cf84-4123-97cf-f0e8279e1017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:20.576994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6e1f2249-cf84-4123-97cf-f0e8279e1017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:20.655406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:20.685622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f2249-cf84-4123-97cf-f0e8279e1017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:08:20.687066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f2249-cf84-4123-97cf-f0e8279e1017 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:08:20.705911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 743/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:08:23.016805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf29e0c-21bc-4e8d-905b-214b2b90c9d5 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:23.017355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf29e0c-21bc-4e8d-905b-214b2b90c9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:23.017355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf29e0c-21bc-4e8d-905b-214b2b90c9d5 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:23.018700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 748/1491] 10.222.0.45 () {54 vars in 927 bytes} [Thu Aug 25 05:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:08:23.023946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c2d92-9403-448d-a949-e521741c0d24 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:23.024392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c2d92-9403-448d-a949-e521741c0d24 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:23.024501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c2d92-9403-448d-a949-e521741c0d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:23.089646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ff2c2d92-9403-448d-a949-e521741c0d24 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:08:23.090861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ff2c2d92-9403-448d-a949-e521741c0d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:23.187150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 744/1492] 10.222.0.45 () {58 vars in 1024 bytes} [Thu Aug 25 05:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:08:23.476775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf29e0c-21bc-4e8d-905b-214b2b90c9d5 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:08:23.478316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-edf29e0c-21bc-4e8d-905b-214b2b90c9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:23.579274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf29e0c-21bc-4e8d-905b-214b2b90c9d5 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:08:23.653515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc99953-bd9b-4a9b-a488-d1d3aa7b107b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:08:23.654114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc99953-bd9b-4a9b-a488-d1d3aa7b107b service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:08:23.654387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc99953-bd9b-4a9b-a488-d1d3aa7b107b service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:08:23.654653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc99953-bd9b-4a9b-a488-d1d3aa7b107b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:08:23.656266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9fc99953-bd9b-4a9b-a488-d1d3aa7b107b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:08:23.665954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:23.765380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc99953-bd9b-4a9b-a488-d1d3aa7b107b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:08:23.766832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc99953-bd9b-4a9b-a488-d1d3aa7b107b service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:08:23.785023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 749/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:08:33.185329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=82 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:08:33.782757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=50 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:57.421251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:57.421849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:57.421849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:57.496816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:09:57.498031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:57.591672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 745/1494] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:09:57.600478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36d0b-345c-46e4-a2f0-e5cffb981a1e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:57.600981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36d0b-345c-46e4-a2f0-e5cffb981a1e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:57.601098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c36d0b-345c-46e4-a2f0-e5cffb981a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:57.676789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-c5c36d0b-345c-46e4-a2f0-e5cffb981a1e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:09:57.678508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c5c36d0b-345c-46e4-a2f0-e5cffb981a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:57.775146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 750/1495] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:09:57.779830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:57.781152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:57.792998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c44e6-f837-412b-b34d-5caf063ba0a7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:57.860989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:57.895184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:57.896421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:57.896740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:57.897207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:57.898052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:09:57.898522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:57.899852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:09:57.899852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:09:57.899852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:09:57.900780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:57.913466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 746/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:09:57.921752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36d0b-345c-46e4-a2f0-e5cffb981a1e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:57.931411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c36d0b-345c-46e4-a2f0-e5cffb981a1e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:57.998200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:58.036184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:58.037310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:58.037596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:58.037868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:58.038495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:58.041313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING py.warnings [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:09:58.041313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: warnings.warn(msg) Aug 25 05:09:58.041313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: Aug 25 05:09:58.041613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:58.174256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 751/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:09:57 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:09:58.178957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:58.180505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:58.215311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad0bc5-9c9a-474d-b672-412093ebd1f4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:58.307289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:58.307890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:58.308194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:58.308465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:58.309080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:58.310088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:09:58.310088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:09:58.310088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:09:58.311300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:58.431194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 747/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:09:58 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:09:58.435550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:58.437137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:58.500521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9f1c6-b980-415f-8aec-9e29a65c3149 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:58.586663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:58.597012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:58.597620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:58.597893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:58.598228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:58.599140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:58.599884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING py.warnings [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:09:58.599884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: warnings.warn(msg) Aug 25 05:09:58.599884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: Aug 25 05:09:58.601840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:58.613513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 752/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:09:58.618210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:58.619712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:58.631573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd589d-c5fc-43b5-89bb-9a1f297e0b23 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:58.656150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:58.725686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3d464-18aa-4995-9ad5-2b7285b1adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:58.726300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3d464-18aa-4995-9ad5-2b7285b1adc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:58.726569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3d464-18aa-4995-9ad5-2b7285b1adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:58.726830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3d464-18aa-4995-9ad5-2b7285b1adc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:58.727472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3d464-18aa-4995-9ad5-2b7285b1adc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:58.728529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-afc3d464-18aa-4995-9ad5-2b7285b1adc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:09:58.728529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:09:58.728529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:09:58.729418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3d464-18aa-4995-9ad5-2b7285b1adc7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:58.746883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 748/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:09:58.751426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:58.752929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:58.787223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea8a1f-97ae-4015-bdf2-b742afe436bb admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:58.881537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d481bf-4b84-4c97-8744-549a36f61122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:58.882189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d481bf-4b84-4c97-8744-549a36f61122 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:58.882460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d481bf-4b84-4c97-8744-549a36f61122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:58.882725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d481bf-4b84-4c97-8744-549a36f61122 admin admin] PATH_INFO: `/v3/projects/e680499ee6944123ad1cf6e97f5b2f8a/users/53f9e941c52643029e18ddfb80840cac/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:58.904131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d481bf-4b84-4c97-8744-549a36f61122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e680499ee6944123ad1cf6e97f5b2f8a, user_id=53f9e941c52643029e18ddfb80840cac, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:58.905169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING py.warnings [None req-e9d481bf-4b84-4c97-8744-549a36f61122 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:09:58.905169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: warnings.warn(msg) Aug 25 05:09:58.905169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: Aug 25 05:09:58.907323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d481bf-4b84-4c97-8744-549a36f61122 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:58.984254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 753/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:09:58 2022] PUT /identity/v3/projects/e680499ee6944123ad1cf6e97f5b2f8a/users/53f9e941c52643029e18ddfb80840cac/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:09:58.997338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377b0e9-8cac-47ef-a2e1-62833012a353 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:58.997648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377b0e9-8cac-47ef-a2e1-62833012a353 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:58.997929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377b0e9-8cac-47ef-a2e1-62833012a353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:59.055022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2377b0e9-8cac-47ef-a2e1-62833012a353 None None] MFA Rules not processed for user `53f9e941c52643029e18ddfb80840cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:09:59.056215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2377b0e9-8cac-47ef-a2e1-62833012a353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:59.137271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 749/1502] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:09:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:09:59.150844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762af913-e229-4a30-9911-b426170afe92 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:59.151131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762af913-e229-4a30-9911-b426170afe92 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:59.151402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762af913-e229-4a30-9911-b426170afe92 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:59.155466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 754/1503] 10.222.0.45 () {54 vars in 964 bytes} [Thu Aug 25 05:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:09:59.157466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed94c-8389-4294-ace9-14b57fe6489d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:59.157780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed94c-8389-4294-ace9-14b57fe6489d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:59.158060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed94c-8389-4294-ace9-14b57fe6489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:59.191115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:59.237745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f0aed94c-8389-4294-ace9-14b57fe6489d None None] MFA Rules not processed for user `2cc606d7aea34bf09af6ae2dd0f98902`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:09:59.238985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f0aed94c-8389-4294-ace9-14b57fe6489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:59.314851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 750/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Thu Aug 25 05:09:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:09:59.322764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762af913-e229-4a30-9911-b426170afe92 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:59.324377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-762af913-e229-4a30-9911-b426170afe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:59.375177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:59.429301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762af913-e229-4a30-9911-b426170afe92 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:59.502509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:59.503112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:59.503389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:59.503661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:59.505352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:59.604448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:59.605800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:59.609506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:09:59.623424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 755/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:09:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:09:59.668981 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fad718-0e22-4c8b-9d13-6c95b359fc4d None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:59.669404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fad718-0e22-4c8b-9d13-6c95b359fc4d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:59.669538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fad718-0e22-4c8b-9d13-6c95b359fc4d None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:59.670788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 751/1506] 10.222.0.45 () {52 vars in 830 bytes} [Thu Aug 25 05:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:09:59.674289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:09:59.675493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:09:59.774547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81905ae4-d32a-4827-b098-2ffe4ed2d8a4 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:09:59.869205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:09:59.869755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:09:59.870028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:09:59.870298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] PATH_INFO: `/v3/users/53f9e941c52643029e18ddfb80840cac` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:09:59.883293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f9e941c52643029e18ddfb80840cac)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:09:59.886080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING py.warnings [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:09:59.886080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: warnings.warn(msg) Aug 25 05:09:59.886080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: Aug 25 05:09:59.886080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:09:59.895236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:10:00.117883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f9e941c52643029e18ddfb80840cac'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:00.142208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f9e941c52643029e18ddfb80840cac'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:00.142208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f9e941c52643029e18ddfb80840cac'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:00.278103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f9e941c52643029e18ddfb80840cac'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:00.293783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f9e941c52643029e18ddfb80840cac'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:00.299579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 756/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:09:59 2022] DELETE /identity/v3/users/53f9e941c52643029e18ddfb80840cac => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:10:00.304171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:10:00.304457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:10:00.304735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:10:00.361689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:10:00.362897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:10:00.439934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:10:00.452822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 752/1508] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:10:00.463251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:10:00.464525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:10:00.566270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9a360-b7af-47af-8fbb-f7dcea0daac6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:10:00.622700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:10:00.641350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe11c-ed5b-4631-90a0-bf20fc4ba6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:10:00.641957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe11c-ed5b-4631-90a0-bf20fc4ba6ac service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:10:00.642231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe11c-ed5b-4631-90a0-bf20fc4ba6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:10:00.642496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe11c-ed5b-4631-90a0-bf20fc4ba6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:10:00.644109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c0abe11c-ed5b-4631-90a0-bf20fc4ba6ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:10:00.757643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe11c-ed5b-4631-90a0-bf20fc4ba6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:10:00.759119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe11c-ed5b-4631-90a0-bf20fc4ba6ac service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:10:00.785618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 757/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:10:01.274820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:10:01.276414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:10:01.288176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32df17d-2753-4a70-a151-18e62a040b25 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:10:01.385220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:10:01.385885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:10:01.386164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:10:01.386436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] PATH_INFO: `/v3/projects/e680499ee6944123ad1cf6e97f5b2f8a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:10:01.397618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e680499ee6944123ad1cf6e97f5b2f8a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:10:01.398667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:10:01.398667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:10:01.398667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:10:01.399881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:10:01.525354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e680499ee6944123ad1cf6e97f5b2f8a', 'request_id': 'req-acd7deb9-32a5-4841-934b-9bd66a52f4f9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:01.531331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e680499ee6944123ad1cf6e97f5b2f8a', 'request_id': 'req-acd7deb9-32a5-4841-934b-9bd66a52f4f9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:01.591754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e680499ee6944123ad1cf6e97f5b2f8a', 'request_id': 'req-acd7deb9-32a5-4841-934b-9bd66a52f4f9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:01.623369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] The token cache is being invalidate because project e680499ee6944123ad1cf6e97f5b2f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:10:01.623652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:01.624101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-acd7deb9-32a5-4841-934b-9bd66a52f4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:10:01.625480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 753/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:10:01 2022] DELETE /identity/v3/projects/e680499ee6944123ad1cf6e97f5b2f8a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:10:10.783241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=62 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:10:11.628831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:11:37.179205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798dc1-4453-4f14-a69b-7b943d5914bd None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:37.179939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798dc1-4453-4f14-a69b-7b943d5914bd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:37.180066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798dc1-4453-4f14-a69b-7b943d5914bd None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:37.181428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:11:37.186285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ce3b2-6527-4be3-8859-7562563dc280 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:37.191585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ce3b2-6527-4be3-8859-7562563dc280 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:37.191585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ce3b2-6527-4be3-8859-7562563dc280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:37.275997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b39ce3b2-6527-4be3-8859-7562563dc280 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:37.277455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b39ce3b2-6527-4be3-8859-7562563dc280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:37.380306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:11:37.534054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb798dc1-4453-4f14-a69b-7b943d5914bd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:11:37.536177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bb798dc1-4453-4f14-a69b-7b943d5914bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:37.654600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb798dc1-4453-4f14-a69b-7b943d5914bd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:11:37.660017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a011f2-708a-4b52-8494-3b66e288f773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:11:37.660617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a011f2-708a-4b52-8494-3b66e288f773 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:37.660893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a011f2-708a-4b52-8494-3b66e288f773 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:37.661164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a011f2-708a-4b52-8494-3b66e288f773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:37.669307 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a011f2-708a-4b52-8494-3b66e288f773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:11:37.670888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a011f2-708a-4b52-8494-3b66e288f773 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:11:37.682229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 759/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:11:38.580217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127738-2f63-40a8-aa57-a0c15e00250e None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:38.580761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127738-2f63-40a8-aa57-a0c15e00250e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:38.580761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127738-2f63-40a8-aa57-a0c15e00250e None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:38.582115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:11:38.589430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2170f-2137-408e-ab1f-2105055a4c57 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:38.590580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2170f-2137-408e-ab1f-2105055a4c57 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:38.590580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2170f-2137-408e-ab1f-2105055a4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:38.612888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2cc2170f-2137-408e-ab1f-2105055a4c57 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:38.614103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2cc2170f-2137-408e-ab1f-2105055a4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:38.625967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:11:38.812252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127738-2f63-40a8-aa57-a0c15e00250e None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:11:38.827062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5127738-2f63-40a8-aa57-a0c15e00250e None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:11:38.832529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192469-3ce0-4f6a-b5b9-42b1a30e43ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:11:38.833057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192469-3ce0-4f6a-b5b9-42b1a30e43ce service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:38.833332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192469-3ce0-4f6a-b5b9-42b1a30e43ce service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:38.833601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192469-3ce0-4f6a-b5b9-42b1a30e43ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:38.842399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf192469-3ce0-4f6a-b5b9-42b1a30e43ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:11:38.844056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf192469-3ce0-4f6a-b5b9-42b1a30e43ce service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:11:38.854515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 756/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:11:39.371843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b6612-6434-4f51-9222-13ada60e0ebb None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:39.372166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b6612-6434-4f51-9222-13ada60e0ebb None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:39.372445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b6612-6434-4f51-9222-13ada60e0ebb None None] PATH_INFO: `/v3` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:39.373753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 761/1517] 10.222.0.55 () {54 vars in 925 bytes} [Thu Aug 25 05:11:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:11:39.399867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa27921-9ac6-422c-95bc-bb0bbd16565e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:39.400180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa27921-9ac6-422c-95bc-bb0bbd16565e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:39.400451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa27921-9ac6-422c-95bc-bb0bbd16565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:39.460379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0aa27921-9ac6-422c-95bc-bb0bbd16565e None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:39.461724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0aa27921-9ac6-422c-95bc-bb0bbd16565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:39.478546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:11:39.532234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 757/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Aug 25 05:11:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:11:43.664874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2640ec-9c57-46a6-9622-0a2298f6196e None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:43.665410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2640ec-9c57-46a6-9622-0a2298f6196e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:43.665410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2640ec-9c57-46a6-9622-0a2298f6196e None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:43.666570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 762/1519] 10.222.0.45 () {54 vars in 961 bytes} [Thu Aug 25 05:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:11:43.671663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588dcf9-bc16-4b4b-b926-442614072a41 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:43.672116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588dcf9-bc16-4b4b-b926-442614072a41 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:43.672258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588dcf9-bc16-4b4b-b926-442614072a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:43.691704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-7588dcf9-bc16-4b4b-b926-442614072a41 None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:43.692951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7588dcf9-bc16-4b4b-b926-442614072a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:43.702163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 758/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Aug 25 05:11:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:11:43.710019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2640ec-9c57-46a6-9622-0a2298f6196e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:11:43.724094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2640ec-9c57-46a6-9622-0a2298f6196e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:11:43.729812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b082f99-2f2d-4304-9168-085dab8f06aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:11:43.732710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b082f99-2f2d-4304-9168-085dab8f06aa service placement] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:43.732710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b082f99-2f2d-4304-9168-085dab8f06aa service placement] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:43.732710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b082f99-2f2d-4304-9168-085dab8f06aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:43.739399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b082f99-2f2d-4304-9168-085dab8f06aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:11:43.741060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b082f99-2f2d-4304-9168-085dab8f06aa service placement] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:11:43.750611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 763/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:11:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:11:50.093956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961dbbe-39db-496c-845a-88b41d982c93 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:50.094634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961dbbe-39db-496c-845a-88b41d982c93 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:50.094634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961dbbe-39db-496c-845a-88b41d982c93 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:50.095862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:11:50.100688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bae32-caa8-4e27-a27d-4bf0a751e5d6 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:50.101771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bae32-caa8-4e27-a27d-4bf0a751e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:50.102123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bae32-caa8-4e27-a27d-4bf0a751e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:50.121728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-583bae32-caa8-4e27-a27d-4bf0a751e5d6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:50.122929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-583bae32-caa8-4e27-a27d-4bf0a751e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:50.130685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:11:50.286737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961dbbe-39db-496c-845a-88b41d982c93 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:11:50.301421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961dbbe-39db-496c-845a-88b41d982c93 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:11:50.306816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1cead-af4c-41b0-9662-1d0b105f494b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:11:50.307404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1cead-af4c-41b0-9662-1d0b105f494b service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:50.307678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1cead-af4c-41b0-9662-1d0b105f494b service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:50.307966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1cead-af4c-41b0-9662-1d0b105f494b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:50.315894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1cead-af4c-41b0-9662-1d0b105f494b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:11:50.317496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1cead-af4c-41b0-9662-1d0b105f494b service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:11:50.326884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 760/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:11:51.145548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684acc8-cb28-4664-8219-7983c7e0a4c6 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:51.149623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684acc8-cb28-4664-8219-7983c7e0a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:51.149623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684acc8-cb28-4664-8219-7983c7e0a4c6 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:51.149623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 05:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:11:51.152806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a40cd-c56c-42ea-b5d5-dfe859e7264c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:51.153247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a40cd-c56c-42ea-b5d5-dfe859e7264c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:51.153351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a40cd-c56c-42ea-b5d5-dfe859e7264c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:51.173315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-188a40cd-c56c-42ea-b5d5-dfe859e7264c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:51.174558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-188a40cd-c56c-42ea-b5d5-dfe859e7264c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:51.182964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 05:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:11:51.337846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684acc8-cb28-4664-8219-7983c7e0a4c6 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:11:51.352232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684acc8-cb28-4664-8219-7983c7e0a4c6 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:11:51.357660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46a5d6-3a37-422f-9fa9-0e5452b53af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:11:51.358243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a5d6-3a37-422f-9fa9-0e5452b53af6 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:51.358517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a5d6-3a37-422f-9fa9-0e5452b53af6 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:51.358786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46a5d6-3a37-422f-9fa9-0e5452b53af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:51.367289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46a5d6-3a37-422f-9fa9-0e5452b53af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:11:51.368922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46a5d6-3a37-422f-9fa9-0e5452b53af6 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:11:51.378698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 766/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:11:55.315293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789fa68-97ec-4dbd-8393-9c7923a8e8fd None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:55.315871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789fa68-97ec-4dbd-8393-9c7923a8e8fd None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:55.315871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789fa68-97ec-4dbd-8393-9c7923a8e8fd None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:55.317281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:11:55.322971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f62e-575a-40b0-aa62-cfac45059303 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:55.323420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f62e-575a-40b0-aa62-cfac45059303 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:55.323523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469f62e-575a-40b0-aa62-cfac45059303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:55.343246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8469f62e-575a-40b0-aa62-cfac45059303 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:55.344498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8469f62e-575a-40b0-aa62-cfac45059303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:55.352794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:11:55.656504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789fa68-97ec-4dbd-8393-9c7923a8e8fd None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:11:55.658180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7789fa68-97ec-4dbd-8393-9c7923a8e8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:55.739050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789fa68-97ec-4dbd-8393-9c7923a8e8fd None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:11:55.743281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4bb26-8a36-4519-a6e3-1fb306e4ce19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:11:55.743879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4bb26-8a36-4519-a6e3-1fb306e4ce19 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:55.744178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4bb26-8a36-4519-a6e3-1fb306e4ce19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:55.744448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4bb26-8a36-4519-a6e3-1fb306e4ce19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:55.753040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4bb26-8a36-4519-a6e3-1fb306e4ce19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:11:55.754467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4bb26-8a36-4519-a6e3-1fb306e4ce19 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:11:55.763825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 763/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:11:57.665230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bcfdf-4e2b-46ff-9f35-5a5d7a381a9e None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:57.665796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bcfdf-4e2b-46ff-9f35-5a5d7a381a9e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:57.665796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bcfdf-4e2b-46ff-9f35-5a5d7a381a9e None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:57.667133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:11:57.672279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484dd01-53b8-457b-9a60-e5c01c7ed4d5 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:57.672727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484dd01-53b8-457b-9a60-e5c01c7ed4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:57.672834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484dd01-53b8-457b-9a60-e5c01c7ed4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:57.692603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-d484dd01-53b8-457b-9a60-e5c01c7ed4d5 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:11:57.693808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d484dd01-53b8-457b-9a60-e5c01c7ed4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:11:57.702329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:11:57.988638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bcfdf-4e2b-46ff-9f35-5a5d7a381a9e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:11:57.999319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bcfdf-4e2b-46ff-9f35-5a5d7a381a9e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:11:58.002777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb99a54-4646-42ff-966e-d230f1d9fef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:11:58.003370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99a54-4646-42ff-966e-d230f1d9fef6 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:11:58.003643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99a54-4646-42ff-966e-d230f1d9fef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:11:58.003932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb99a54-4646-42ff-966e-d230f1d9fef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:11:58.013175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb99a54-4646-42ff-966e-d230f1d9fef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:11:58.014604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb99a54-4646-42ff-966e-d230f1d9fef6 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:11:58.024475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 769/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:12:01.520140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560706dd-5619-422a-886a-7fc6cdcf5b87 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:12:01.520681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560706dd-5619-422a-886a-7fc6cdcf5b87 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:12:01.520681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560706dd-5619-422a-886a-7fc6cdcf5b87 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:12:01.522031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:12:01.527658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f88a-19db-42aa-89b4-8621a25534ee None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:12:01.528136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f88a-19db-42aa-89b4-8621a25534ee None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:12:01.528233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f88a-19db-42aa-89b4-8621a25534ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:12:01.535747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=81 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:12:01.548233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-eef6f88a-19db-42aa-89b4-8621a25534ee None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:12:01.549471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-eef6f88a-19db-42aa-89b4-8621a25534ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:12:01.557263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:12:02.113411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560706dd-5619-422a-886a-7fc6cdcf5b87 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:12:02.115096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-560706dd-5619-422a-886a-7fc6cdcf5b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:12:02.178986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:12:02.191929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560706dd-5619-422a-886a-7fc6cdcf5b87 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:12:02.195743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f357ba-f73f-46f9-add1-35c1389dbcec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:12:02.196373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f357ba-f73f-46f9-add1-35c1389dbcec service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:12:02.196657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f357ba-f73f-46f9-add1-35c1389dbcec service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:12:02.196929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f357ba-f73f-46f9-add1-35c1389dbcec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:12:02.205739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f357ba-f73f-46f9-add1-35c1389dbcec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:12:02.207287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f357ba-f73f-46f9-add1-35c1389dbcec service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:12:02.217688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 766/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:12:04.241093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6403af-ecf4-4693-9a43-fd4c7a329dd9 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:12:04.242361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6403af-ecf4-4693-9a43-fd4c7a329dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:12:04.242646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6403af-ecf4-4693-9a43-fd4c7a329dd9 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:12:04.244046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 05:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:12:04.249517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0b36b-1c48-48c5-adde-85eeb1c9f577 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:12:04.249939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0b36b-1c48-48c5-adde-85eeb1c9f577 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:12:04.250097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0b36b-1c48-48c5-adde-85eeb1c9f577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:12:04.269278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f4c0b36b-1c48-48c5-adde-85eeb1c9f577 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:12:04.270517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f4c0b36b-1c48-48c5-adde-85eeb1c9f577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:12:04.278677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:12:04.831879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6403af-ecf4-4693-9a43-fd4c7a329dd9 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:12:04.833626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ca6403af-ecf4-4693-9a43-fd4c7a329dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:12:04.847453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6403af-ecf4-4693-9a43-fd4c7a329dd9 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:12:04.851000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb6b91-6ef4-48fe-803d-78a1df88e4fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:12:04.851580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6b91-6ef4-48fe-803d-78a1df88e4fd service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:12:04.851861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6b91-6ef4-48fe-803d-78a1df88e4fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:12:04.852159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6b91-6ef4-48fe-803d-78a1df88e4fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:12:04.861185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6b91-6ef4-48fe-803d-78a1df88e4fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:12:04.869221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6b91-6ef4-48fe-803d-78a1df88e4fd service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:12:04.871898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 772/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:12:14.264566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=11 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:12:14.867779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=8 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:34.363279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953fa01-b30d-4838-9d06-a0cecf223656 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.365117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953fa01-b30d-4838-9d06-a0cecf223656 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.365510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953fa01-b30d-4838-9d06-a0cecf223656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.390456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c953fa01-b30d-4838-9d06-a0cecf223656 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:34.391681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c953fa01-b30d-4838-9d06-a0cecf223656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:34.401995 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 768/1540] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:34.416395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9feb28-3bac-4487-901f-a8032c5bd945 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.416967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9feb28-3bac-4487-901f-a8032c5bd945 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.416967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9feb28-3bac-4487-901f-a8032c5bd945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.446666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-4e9feb28-3bac-4487-901f-a8032c5bd945 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:34.447884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4e9feb28-3bac-4487-901f-a8032c5bd945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:34.463929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 773/1541] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:34.465298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953fa01-b30d-4838-9d06-a0cecf223656 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:34.478525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953fa01-b30d-4838-9d06-a0cecf223656 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:34.498756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a60a4-5de5-4c44-80b8-3c0387af0889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:34.499388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a60a4-5de5-4c44-80b8-3c0387af0889 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.499666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a60a4-5de5-4c44-80b8-3c0387af0889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.499958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a60a4-5de5-4c44-80b8-3c0387af0889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.500624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a60a4-5de5-4c44-80b8-3c0387af0889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:34.500928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a60a4-5de5-4c44-80b8-3c0387af0889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:34.502559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a60a4-5de5-4c44-80b8-3c0387af0889 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:34.522700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 769/1542] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:34.531411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9feb28-3bac-4487-901f-a8032c5bd945 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:34.546592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9feb28-3bac-4487-901f-a8032c5bd945 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:34.551323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:34.556850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.557139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.557419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.558079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:34.560198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:34.610026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4893-ccc6-4dee-9bef-5f59b881665d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.610404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4893-ccc6-4dee-9bef-5f59b881665d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.610855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4893-ccc6-4dee-9bef-5f59b881665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.653178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f80c4893-ccc6-4dee-9bef-5f59b881665d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:34.654452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f80c4893-ccc6-4dee-9bef-5f59b881665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:34.669640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 770/1543] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:34.678900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9302-238d-495d-b2f9-598c8d7dbf85 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.679207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9302-238d-495d-b2f9-598c8d7dbf85 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.679467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9302-238d-495d-b2f9-598c8d7dbf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.694920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 774/1544] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:34.701394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:34.711939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b3ba9302-238d-495d-b2f9-598c8d7dbf85 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:34.711939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b3ba9302-238d-495d-b2f9-598c8d7dbf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:34.810590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8753b-4962-41d5-947a-e0ad7f63a668 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:34.815623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ab6fb-dac7-42ae-9b01-b0036777b2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:34.821151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab6fb-dac7-42ae-9b01-b0036777b2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.821530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab6fb-dac7-42ae-9b01-b0036777b2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.821887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ab6fb-dac7-42ae-9b01-b0036777b2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.822488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ab6fb-dac7-42ae-9b01-b0036777b2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:34.823641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING py.warnings [None req-e27ab6fb-dac7-42ae-9b01-b0036777b2c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:13:34.823641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: warnings.warn(msg) Aug 25 05:13:34.823641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: Aug 25 05:13:34.825053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ab6fb-dac7-42ae-9b01-b0036777b2c2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:34.845401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 771/1545] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:34.850437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba9302-238d-495d-b2f9-598c8d7dbf85 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:34.861832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba9302-238d-495d-b2f9-598c8d7dbf85 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:34.871701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:34.872378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.872660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.872972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.873649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:34.873961 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:34.875686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:34.895569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 772/1546] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:34.903594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:34.917851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642fca7-425e-4863-9a3c-451a9b8fe130 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:34.926369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:34.927029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.927285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.927555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:34.928228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:34.929256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:13:34.929256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:13:34.929256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:13:34.930461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:34.989470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 775/1547] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:34.990775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c218e-2005-4db7-8a9d-886e5d3f4a41 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:34.991059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c218e-2005-4db7-8a9d-886e5d3f4a41 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:34.991329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c218e-2005-4db7-8a9d-886e5d3f4a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.020547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-bc4c218e-2005-4db7-8a9d-886e5d3f4a41 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.021836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bc4c218e-2005-4db7-8a9d-886e5d3f4a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.030758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 776/1548] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.032036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425f85-78e6-406b-acf6-e6486e4e6eef None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.032316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425f85-78e6-406b-acf6-e6486e4e6eef None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.032585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425f85-78e6-406b-acf6-e6486e4e6eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.054591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1b425f85-78e6-406b-acf6-e6486e4e6eef None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.056014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1b425f85-78e6-406b-acf6-e6486e4e6eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.064587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 777/1549] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.065458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425f85-78e6-406b-acf6-e6486e4e6eef None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.076063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425f85-78e6-406b-acf6-e6486e4e6eef None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.080908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691b44b-8924-4ee6-bcf3-38a88822a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.081507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b44b-8924-4ee6-bcf3-38a88822a07a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.081780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b44b-8924-4ee6-bcf3-38a88822a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.082048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691b44b-8924-4ee6-bcf3-38a88822a07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.082684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691b44b-8924-4ee6-bcf3-38a88822a07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.085035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691b44b-8924-4ee6-bcf3-38a88822a07a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.097614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 778/1550] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:35.097614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340bda-903b-4f98-a2aa-2a36e393a898 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.097614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340bda-903b-4f98-a2aa-2a36e393a898 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.097614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340bda-903b-4f98-a2aa-2a36e393a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.117971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-04340bda-903b-4f98-a2aa-2a36e393a898 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.119202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-04340bda-903b-4f98-a2aa-2a36e393a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.127105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 779/1551] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.128291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ca1eb-dac5-4533-ab2c-1f189b2d577a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.128569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ca1eb-dac5-4533-ab2c-1f189b2d577a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.128841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ca1eb-dac5-4533-ab2c-1f189b2d577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.147844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a19ca1eb-dac5-4533-ab2c-1f189b2d577a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.149047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a19ca1eb-dac5-4533-ab2c-1f189b2d577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.156858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 780/1552] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.158009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88ec6-acf5-4e6c-9c00-2636dbea4a6a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.158285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88ec6-acf5-4e6c-9c00-2636dbea4a6a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.158553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88ec6-acf5-4e6c-9c00-2636dbea4a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.177992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-95a88ec6-acf5-4e6c-9c00-2636dbea4a6a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.179090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-95a88ec6-acf5-4e6c-9c00-2636dbea4a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.186976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 781/1553] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.188157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d28497-95c4-475e-8aab-ef2c07c06ff1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.188436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d28497-95c4-475e-8aab-ef2c07c06ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.188706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d28497-95c4-475e-8aab-ef2c07c06ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.207365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-32d28497-95c4-475e-8aab-ef2c07c06ff1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.209100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-32d28497-95c4-475e-8aab-ef2c07c06ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.217000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 782/1554] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.218143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39137a-1cd7-4e37-bb1b-1351cceec1b6 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.218420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39137a-1cd7-4e37-bb1b-1351cceec1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.218690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39137a-1cd7-4e37-bb1b-1351cceec1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.237544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 773/1555] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:34 2022] POST /identity/v3/projects => generated 387 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:13:35.243737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1b39137a-1cd7-4e37-bb1b-1351cceec1b6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.243887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.244069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1b39137a-1cd7-4e37-bb1b-1351cceec1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.300719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6d94c-8fe0-4fb6-b478-249a0b439f50 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.302435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 783/1556] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.303698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66ceb8-5a8b-4295-b46b-cd2a169d2f6e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.304008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66ceb8-5a8b-4295-b46b-cd2a169d2f6e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.304278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66ceb8-5a8b-4295-b46b-cd2a169d2f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.306607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b76db-ba41-4371-bf97-34282383dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.307327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b76db-ba41-4371-bf97-34282383dd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.307608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b76db-ba41-4371-bf97-34282383dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.307942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b76db-ba41-4371-bf97-34282383dd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.308584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b76db-ba41-4371-bf97-34282383dd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.310223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b76db-ba41-4371-bf97-34282383dd4e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.311694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:35.323670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 774/1557] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:35.323670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f4b0-ff82-4e91-bae9-72efbb668d4f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.323670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f4b0-ff82-4e91-bae9-72efbb668d4f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.323670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3f4b0-ff82-4e91-bae9-72efbb668d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.325175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-bd66ceb8-5a8b-4295-b46b-cd2a169d2f6e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.326533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bd66ceb8-5a8b-4295-b46b-cd2a169d2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.335474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 784/1558] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.336112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66ceb8-5a8b-4295-b46b-cd2a169d2f6e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.345617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-afb3f4b0-ff82-4e91-bae9-72efbb668d4f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.346970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-afb3f4b0-ff82-4e91-bae9-72efbb668d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.347401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66ceb8-5a8b-4295-b46b-cd2a169d2f6e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.352044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.352689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.352962 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.353229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.353875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:35.354455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.355542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 775/1559] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.356774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37007d-356e-4363-beff-45f4375f71ab None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.357059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37007d-356e-4363-beff-45f4375f71ab None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.357332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37007d-356e-4363-beff-45f4375f71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.360316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING py.warnings [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:13:35.360316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: warnings.warn(msg) Aug 25 05:13:35.360316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: Aug 25 05:13:35.361555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b263e90e-7feb-4b6c-9055-d0c08e6595df admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.381675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 785/1560] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:35.381675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb84e6-2d03-43e8-9e09-874eb587e19b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.381675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb84e6-2d03-43e8-9e09-874eb587e19b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.381675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb84e6-2d03-43e8-9e09-874eb587e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.382115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-db37007d-356e-4363-beff-45f4375f71ab None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.382115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-db37007d-356e-4363-beff-45f4375f71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.386958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 776/1561] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.387818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37007d-356e-4363-beff-45f4375f71ab None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.398018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37007d-356e-4363-beff-45f4375f71ab None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.399276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8fbb84e6-2d03-43e8-9e09-874eb587e19b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.400674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8fbb84e6-2d03-43e8-9e09-874eb587e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.403512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e1e3c-ffad-428f-bfac-babde5f2c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.404158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e1e3c-ffad-428f-bfac-babde5f2c677 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.404438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e1e3c-ffad-428f-bfac-babde5f2c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.404713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e1e3c-ffad-428f-bfac-babde5f2c677 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.405346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e1e3c-ffad-428f-bfac-babde5f2c677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.407325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e1e3c-ffad-428f-bfac-babde5f2c677 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.408800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 786/1562] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.411808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb84e6-2d03-43e8-9e09-874eb587e19b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.419708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb84e6-2d03-43e8-9e09-874eb587e19b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.424581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.425176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.425481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.425755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.426395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:35.427217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.428894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.440442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 787/1563] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:35.441348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.451482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89029be-0756-4f97-905f-797212d438ec admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.456288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.456929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.457207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.457480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] PATH_INFO: `/v3/projects/ae8fcca5d13a4f648bbadb4d6c0bc236/users/9ab8473b2bcf4a2f80d990ee39aac517/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.474591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8fcca5d13a4f648bbadb4d6c0bc236, user_id=9ab8473b2bcf4a2f80d990ee39aac517, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.477631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.495556 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 777/1564] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:35.497927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d292cb-070f-444f-add1-47df9b56ccee None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.497927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d292cb-070f-444f-add1-47df9b56ccee None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.497927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d292cb-070f-444f-add1-47df9b56ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.505743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:35.517256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-57d292cb-070f-444f-add1-47df9b56ccee None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.518446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-57d292cb-070f-444f-add1-47df9b56ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.527894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 778/1565] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.527894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d292cb-070f-444f-add1-47df9b56ccee None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.537039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d292cb-070f-444f-add1-47df9b56ccee None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.541675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.542241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.542514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.542783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.543407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:35.543736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.545398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.557501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 779/1566] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:35.561239 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.561502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 788/1567] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:35 2022] PUT /identity/v3/projects/ae8fcca5d13a4f648bbadb4d6c0bc236/users/9ab8473b2bcf4a2f80d990ee39aac517/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:35.562516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.568217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee5062-955c-4951-9388-e4651237995b admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.625653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.626265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.626546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.626936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.627569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.629536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.632370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9b22-5499-45be-8feb-27629c3ac3cd admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.637021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.637618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.637894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.638163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.638803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:35.639104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.640734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.652780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 789/1568] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:35.653734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.663169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af7dfb-ca04-42aa-a2fe-efaba90bf19f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.674046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.674046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.674046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.674046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.674436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:35.674436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.674436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.683387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 790/1569] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:35.684185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.694645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c61bc-c806-4c34-9896-4bd46784b16a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.699302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.699878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.700185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.700461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.701080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.702989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.741387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 780/1570] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:35.742234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.802281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792e10e-05fa-4868-8a9f-74e5fbfece8f admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.806900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.807493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.807769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.808074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.808703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.810301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.820320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 791/1571] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:35.820939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 781/1572] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:35.823230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.823364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.831085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4197af-3cc7-4375-98e4-85b9b18d0078 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.888582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.888975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:35.889298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.889575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.889843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.890460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.892397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.893065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e463a-8685-410e-81ad-11fee0f9b951 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.897871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb984c-80c4-47c3-aa42-5c497d03f811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.898474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb984c-80c4-47c3-aa42-5c497d03f811 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.898746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb984c-80c4-47c3-aa42-5c497d03f811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.899014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb984c-80c4-47c3-aa42-5c497d03f811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.899686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb984c-80c4-47c3-aa42-5c497d03f811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:35.900025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb984c-80c4-47c3-aa42-5c497d03f811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.901803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb984c-80c4-47c3-aa42-5c497d03f811 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:35.905014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:35.943738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 792/1573] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:35.945196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239ed15-42ec-43fb-833d-f130db949425 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.945488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239ed15-42ec-43fb-833d-f130db949425 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.945766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239ed15-42ec-43fb-833d-f130db949425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.964580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7239ed15-42ec-43fb-833d-f130db949425 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:35.965807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7239ed15-42ec-43fb-833d-f130db949425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:35.973935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 793/1574] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:35.974836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239ed15-42ec-43fb-833d-f130db949425 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:35.985478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239ed15-42ec-43fb-833d-f130db949425 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:35.991509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:35.992205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:35.992525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:35.992838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:35.993536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:35.995535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.043988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 782/1575] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/projects => generated 405 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.044953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.103858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cc3b7-a4a5-49b2-866e-85f68aa605fb admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.108555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.109153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.109434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.109716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.110340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.112563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.134685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 794/1576] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:35 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.135509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.201094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f0ec-a053-443c-864b-f5c0db615f34 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.201094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.201692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.201967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.202239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.202855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.204828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.238650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 783/1577] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.240814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.304643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ef3ee-86d4-44e4-8935-82b1f408b781 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.309767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.310406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.320427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.320723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.321370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.323324 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.369587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 795/1578] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.370434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.380486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957e4b-ba1b-4c55-881d-2e8db9f07869 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.385075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.385704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.386022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.386294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.386926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.388551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.398440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 796/1579] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:36.399607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.403860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 784/1580] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.405308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.410606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d07175-96d1-474d-884d-1303b8bb2282 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.416995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.416995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.416995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.417297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.417678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.419570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.461244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ed50c-759a-4e95-8459-e11391ea3483 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.464730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.465335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.465640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.465910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.475554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.477038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.486580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 785/1581] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:36.487430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.502052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a8923-8e5f-4797-af52-388a0a835b42 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.508344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.508964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.509241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.509514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.510191 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.512150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.521279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:36.536982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 797/1582] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.538498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.604502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588d061-3933-4940-b733-f1647b706452 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.609445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.610071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.610349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.610876 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.611521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.613863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.625010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 786/1583] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/users => generated 303 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.625010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.638536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd5b27-c52c-4e39-9d12-561092f53f08 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.643175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.643795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.644115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.644379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.645013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.647793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.778556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 798/1584] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.778756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 787/1585] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:36.778857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.778974 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.788876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c553e70-bf27-4bba-980f-edfe08226e88 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.789457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1355f2-05ff-40c1-9b0d-8ac32a4f72f9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.793512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.793995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.794159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.794435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.794582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.794705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] PATH_INFO: `/v3/projects/6f992bd094a646acb3ce5182abeb18f8/users/86fd818c1f894c388de9ca49c39a8cde/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.794858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.795125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.795781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.797406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.799547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:36.808735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 799/1586] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:36.809553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.810214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f992bd094a646acb3ce5182abeb18f8, user_id=86fd818c1f894c388de9ca49c39a8cde, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.811416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:13:36.811416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:13:36.811416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:13:36.813571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.819384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea41f0-7ee5-4aa7-96fe-ae7b289ae2da admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.824084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.827525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.827525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.827525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.827525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.827525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.837716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 800/1587] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:36.838482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.847765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4dbac-bf45-417f-a56b-e2cb696b668e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:36.852594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:36.853190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:36.853506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:36.853745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:36.854357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:36.856325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:36.933655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 788/1588] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:36 2022] PUT /identity/v3/projects/6f992bd094a646acb3ce5182abeb18f8/users/86fd818c1f894c388de9ca49c39a8cde/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:36.933655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:36.998766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2694c0-0189-4625-922d-bd28f8f2a8bf admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.001933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 801/1589] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:36 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:37.001933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.005844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.006453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.006731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.006999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.007640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.009337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.013194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6c707-abd3-4b16-9086-77da7d94ac6e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.022553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.022553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.022553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.022553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.022986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 789/1590] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.023069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.023155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.023239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.032350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f54f2-9a8a-4035-931d-e7e2fddd9950 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.034963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 802/1591] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.036431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.040671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.041604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.042016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.042299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.043550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.045291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.046124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ec36a-fe0f-45ac-9f7f-7b6eae41b9f9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.052661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3512be-50eb-4fd9-a37a-5f077209374c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.053267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3512be-50eb-4fd9-a37a-5f077209374c admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.053544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3512be-50eb-4fd9-a37a-5f077209374c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.062942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3512be-50eb-4fd9-a37a-5f077209374c admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.062942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3512be-50eb-4fd9-a37a-5f077209374c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.062942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3512be-50eb-4fd9-a37a-5f077209374c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.063260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 790/1592] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.063260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.072475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 803/1593] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.072475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6961d7-1123-414b-aba1-bf21b04731cd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.072475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6961d7-1123-414b-aba1-bf21b04731cd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.072475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6961d7-1123-414b-aba1-bf21b04731cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.072952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9cf4-2bef-4589-8c48-f5f882b9656b admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.077794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.078519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.078901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.079264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.080021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.081706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.092758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3f6961d7-1123-414b-aba1-bf21b04731cd None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:37.097146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3f6961d7-1123-414b-aba1-bf21b04731cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:37.097268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 791/1594] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.097268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.104348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 804/1595] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:37.107615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a268eb-6d25-4343-90da-7c3102a82307 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.109455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6961d7-1123-414b-aba1-bf21b04731cd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.118810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.119520 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.119753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.120064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.120757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.121868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6961d7-1123-414b-aba1-bf21b04731cd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.122371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.133318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.134071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.134183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 792/1596] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.134267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.134465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.135203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.137170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.137295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.151400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 805/1597] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.151400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.151700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd036023-62f3-4abc-b223-98add58f41b0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.155573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.156287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.156631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.156969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.157816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.159494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.164418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498598-9be1-4df3-a1ec-0ec5294eefde admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.169904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.170517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.170795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.171067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.171458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 793/1598] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.171711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.172523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.173454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.183722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630681-e244-4928-8243-0fab70671b87 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.189204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 806/1599] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.189204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.193303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.194838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.195223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.195594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] PATH_INFO: `/v3/projects/e0e012f8cb9a4667bc78dc7761712f91/users/bbc5cc50796841ffbcf8214a11810bee/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.198214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1433fd-672f-499e-add4-35186dd67b01 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.206982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.207657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.208018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.208292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] PATH_INFO: `/v3/projects/24e23f01dd38467784ef3665ddd71876/users/e8776ca5fe264cee904f8fab1a16a5f6/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.216910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e012f8cb9a4667bc78dc7761712f91, user_id=bbc5cc50796841ffbcf8214a11810bee, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.220022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.229859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e23f01dd38467784ef3665ddd71876, user_id=e8776ca5fe264cee904f8fab1a16a5f6, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.234620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.318093 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 794/1600] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:37 2022] PUT /identity/v3/projects/e0e012f8cb9a4667bc78dc7761712f91/users/bbc5cc50796841ffbcf8214a11810bee/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:37.318842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.320486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:37.339149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 807/1601] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:37 2022] PUT /identity/v3/projects/24e23f01dd38467784ef3665ddd71876/users/e8776ca5fe264cee904f8fab1a16a5f6/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:37.340312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.369154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:37.388298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565ab72-a729-4058-b6eb-158eb1086f11 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.409754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc144-1a84-4125-ba8a-f7225578d043 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.414617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.415229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.415506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.415776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.416460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.418081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.429983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 808/1602] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:37.431264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.441922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7769b-5d6e-438d-9c27-56196391e1cb admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.446560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.447240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.448593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.448593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.448954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.449740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.450025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.450299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] PATH_INFO: `/v3/projects/50f335a94e2d498486a6366dde18f148/users/1750872eb90141f9be755b57268204c2/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.458212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.459674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.468072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f335a94e2d498486a6366dde18f148, user_id=1750872eb90141f9be755b57268204c2, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.470921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 795/1603] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:37.471899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.481025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.482340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24391d85-0568-4d08-858b-fa0736e96ebb service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.489704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf5bce-4b24-44a7-93cf-1944690030ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.490408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5bce-4b24-44a7-93cf-1944690030ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.490688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5bce-4b24-44a7-93cf-1944690030ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.490965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf5bce-4b24-44a7-93cf-1944690030ec admin admin] PATH_INFO: `/v3/projects/519a586812c5441ab148590e1bfe9ea9/users/ebec583ec90b4d819aa92b23f4b35653/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.507953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf5bce-4b24-44a7-93cf-1944690030ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=519a586812c5441ab148590e1bfe9ea9, user_id=ebec583ec90b4d819aa92b23f4b35653, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.510723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf5bce-4b24-44a7-93cf-1944690030ec admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.562940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 809/1604] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:37 2022] PUT /identity/v3/projects/50f335a94e2d498486a6366dde18f148/users/1750872eb90141f9be755b57268204c2/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:37.563814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.593956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:37.596258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 796/1605] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:37 2022] PUT /identity/v3/projects/519a586812c5441ab148590e1bfe9ea9/users/ebec583ec90b4d819aa92b23f4b35653/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:37.600866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed2dee-4ebb-4097-9933-ede5606aef1a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.600866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed2dee-4ebb-4097-9933-ede5606aef1a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.600866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed2dee-4ebb-4097-9933-ede5606aef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.630583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ce12-f886-494d-afef-f12a60afc7b8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.641705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f4ed2dee-4ebb-4097-9933-ede5606aef1a None None] MFA Rules not processed for user `bbc5cc50796841ffbcf8214a11810bee`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:37.643667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f4ed2dee-4ebb-4097-9933-ede5606aef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:37.700656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dceff-b02f-431c-a417-517971e6330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.704076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dceff-b02f-431c-a417-517971e6330c admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.704076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dceff-b02f-431c-a417-517971e6330c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.704076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dceff-b02f-431c-a417-517971e6330c admin admin] PATH_INFO: `/v3/projects/c864397d3d13404091dd844d2173a16e/users/64fdf82f1b6144fc839b947878a81ea5/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.718614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 797/1606] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:37.720059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bef6f-afdf-45d2-a29d-dd3e6ec9492b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.720772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bef6f-afdf-45d2-a29d-dd3e6ec9492b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.721412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bef6f-afdf-45d2-a29d-dd3e6ec9492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.728414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dceff-b02f-431c-a417-517971e6330c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c864397d3d13404091dd844d2173a16e, user_id=64fdf82f1b6144fc839b947878a81ea5, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.732828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dceff-b02f-431c-a417-517971e6330c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.744707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4f8bef6f-afdf-45d2-a29d-dd3e6ec9492b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:37.745951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4f8bef6f-afdf-45d2-a29d-dd3e6ec9492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:37.754214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 798/1607] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:37.755540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bef6f-afdf-45d2-a29d-dd3e6ec9492b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.768410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bef6f-afdf-45d2-a29d-dd3e6ec9492b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:37.773519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e84676-8325-4003-8cc8-99789e084cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:37.774227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e84676-8325-4003-8cc8-99789e084cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.774509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e84676-8325-4003-8cc8-99789e084cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.774783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e84676-8325-4003-8cc8-99789e084cf8 admin admin] PATH_INFO: `/v3/projects/726e0b4b3e824822a909717d8b47d32c/users/acb4017165a64636a4e08478fb682bf4/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.792540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e84676-8325-4003-8cc8-99789e084cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726e0b4b3e824822a909717d8b47d32c, user_id=acb4017165a64636a4e08478fb682bf4, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:37.795470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e84676-8325-4003-8cc8-99789e084cf8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:37.855844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 810/1608] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:37 2022] PUT /identity/v3/projects/c864397d3d13404091dd844d2173a16e/users/64fdf82f1b6144fc839b947878a81ea5/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:37.857488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2545158-3323-45c5-ae9d-65210da3b589 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.857600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2545158-3323-45c5-ae9d-65210da3b589 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.857869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2545158-3323-45c5-ae9d-65210da3b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.891587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a2545158-3323-45c5-ae9d-65210da3b589 None None] MFA Rules not processed for user `1750872eb90141f9be755b57268204c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:37.892985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a2545158-3323-45c5-ae9d-65210da3b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:37.928870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 799/1609] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:37 2022] PUT /identity/v3/projects/726e0b4b3e824822a909717d8b47d32c/users/acb4017165a64636a4e08478fb682bf4/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:37.930392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba007-3932-42df-aedc-ca908909b71f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:37.930778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba007-3932-42df-aedc-ca908909b71f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:37.931153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeba007-3932-42df-aedc-ca908909b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:37.964816 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 811/1610] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:37.966033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2545158-3323-45c5-ae9d-65210da3b589 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:37.986910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-deeba007-3932-42df-aedc-ca908909b71f None None] MFA Rules not processed for user `ebec583ec90b4d819aa92b23f4b35653`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:37.988206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-deeba007-3932-42df-aedc-ca908909b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:38.009626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:38.029955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:38.035202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2545158-3323-45c5-ae9d-65210da3b589 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:38.070583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 800/1611] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:38.070583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba007-3932-42df-aedc-ca908909b71f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:38.121747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fef6b-77a5-4ab4-8977-b8ccfedd2c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:38.122587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fef6b-77a5-4ab4-8977-b8ccfedd2c01 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.122865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fef6b-77a5-4ab4-8977-b8ccfedd2c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.123177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fef6b-77a5-4ab4-8977-b8ccfedd2c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.155313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeba007-3932-42df-aedc-ca908909b71f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:38.159229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f02ab6-01f7-4d96-af86-0f23dfe68479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:38.160157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02ab6-01f7-4d96-af86-0f23dfe68479 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.160601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02ab6-01f7-4d96-af86-0f23dfe68479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.161249 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f02ab6-01f7-4d96-af86-0f23dfe68479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.209762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fef6b-77a5-4ab4-8977-b8ccfedd2c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:38.211267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fef6b-77a5-4ab4-8977-b8ccfedd2c01 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:38.222859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 812/1612] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:38.236072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3c05-af8e-43a6-b321-c02fc7248b1a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.238665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3c05-af8e-43a6-b321-c02fc7248b1a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.239512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd3c05-af8e-43a6-b321-c02fc7248b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.261838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f02ab6-01f7-4d96-af86-0f23dfe68479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:38.264313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f02ab6-01f7-4d96-af86-0f23dfe68479 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:38.276307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 801/1613] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:38.277316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-93fd3c05-af8e-43a6-b321-c02fc7248b1a None None] MFA Rules not processed for user `64fdf82f1b6144fc839b947878a81ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:38.278921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-93fd3c05-af8e-43a6-b321-c02fc7248b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:38.289614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93711a0b-e378-48ad-a6de-78597036a1fe None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.290111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93711a0b-e378-48ad-a6de-78597036a1fe None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.290443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93711a0b-e378-48ad-a6de-78597036a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.327686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-93711a0b-e378-48ad-a6de-78597036a1fe None None] MFA Rules not processed for user `acb4017165a64636a4e08478fb682bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:38.328946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-93711a0b-e378-48ad-a6de-78597036a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:38.413277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:38.418140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 802/1614] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:38.420813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93711a0b-e378-48ad-a6de-78597036a1fe None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:38.428875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 813/1615] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:38.430556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c103d-f546-40cb-975a-d603e6cd27fc None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.431233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c103d-f546-40cb-975a-d603e6cd27fc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.435996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93711a0b-e378-48ad-a6de-78597036a1fe None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:38.436508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c103d-f546-40cb-975a-d603e6cd27fc None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.441655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:38.443345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.443749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.443987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 814/1616] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 25 05:13:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:13:38.444888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.445278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c103d-f546-40cb-975a-d603e6cd27fc None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:38.445981 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:38.448435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:38.465176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c103d-f546-40cb-975a-d603e6cd27fc None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:38.471351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481d683-d0bb-4a6c-80d6-3941ca70c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:38.472466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d683-d0bb-4a6c-80d6-3941ca70c591 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.472979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d683-d0bb-4a6c-80d6-3941ca70c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.473505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481d683-d0bb-4a6c-80d6-3941ca70c591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.474367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481d683-d0bb-4a6c-80d6-3941ca70c591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:38.477089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481d683-d0bb-4a6c-80d6-3941ca70c591 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:38.624340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 803/1617] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:38 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:38.629150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:38.633176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 815/1618] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:38 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:38.634503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e333d-6100-4430-ac40-a9c7fe70a356 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.635392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e333d-6100-4430-ac40-a9c7fe70a356 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.635857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e333d-6100-4430-ac40-a9c7fe70a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.696141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e97e333d-6100-4430-ac40-a9c7fe70a356 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:38.705119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e97e333d-6100-4430-ac40-a9c7fe70a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:38.718192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f07a0c-676e-4031-be85-d9613b3a0e65 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:38.797130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 816/1619] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 25 05:13:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:38.807765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e333d-6100-4430-ac40-a9c7fe70a356 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:38.823050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:38.824341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.824782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.825228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.826018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:38.828649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:38.905865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e333d-6100-4430-ac40-a9c7fe70a356 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:38.910856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:38.911627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:38.912251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:38.912654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:38.913379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:38.915475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.006592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 804/1620] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:38 2022] POST /identity/v3/projects => generated 381 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:39.006592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.074689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:39.081455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 817/1621] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:38 2022] POST /identity/v3/users => generated 309 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:39.082471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.096874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420c00-1af1-4b25-8225-12d18b06df47 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.127279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ab6a3-19c0-4279-9d25-b8299bdebb61 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.136477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.137230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.137517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.137796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.138446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.140725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.192821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.193455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.193729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.194003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.342268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.342268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.342268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 818/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:39.342268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.346174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:39.346174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 805/1623] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:39 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:39.346174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.351143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747ef17-9988-4a00-b70f-6905cb9afdd3 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.359006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.359630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.359929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.360212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.360428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35bb8-8704-4b3b-a4fa-77e7d6ef5853 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.361105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.363040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.385909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.386566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.386852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.387130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.388113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.390968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.405665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 806/1624] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:39.406610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.452000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad5152-15e1-4098-bbfb-a8da003ce97a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.471820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.473627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.473627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.473627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.476075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.483029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.511501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 807/1625] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:39.511501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.520870 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 819/1626] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:39 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:39.521835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.524716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791a58a-fd13-474a-867a-47fa8f324fda admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.532977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.533876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.534876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.535279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] PATH_INFO: `/v3/projects/9e33504a61d44560a112784694ffd0ee/users/7fa34e7f6f1948e9896a6f24e1b7c6e4/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.553395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953b0b-3f83-48a8-8835-261ce6fe5afd admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.558756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e33504a61d44560a112784694ffd0ee, user_id=7fa34e7f6f1948e9896a6f24e1b7c6e4, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.563138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.568589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.569270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.569551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.569825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] PATH_INFO: `/v3/projects/fa1616afc47240d2bb415abfaa40e25d/users/ec9fe23b4e374b5392d5184e161ae50a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.592069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1616afc47240d2bb415abfaa40e25d, user_id=ec9fe23b4e374b5392d5184e161ae50a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.599081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.701467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 808/1627] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:39 2022] PUT /identity/v3/projects/9e33504a61d44560a112784694ffd0ee/users/7fa34e7f6f1948e9896a6f24e1b7c6e4/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:39.702382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.706579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 820/1628] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:39 2022] PUT /identity/v3/projects/fa1616afc47240d2bb415abfaa40e25d/users/ec9fe23b4e374b5392d5184e161ae50a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:39.707471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.801093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26784f4f-d3b4-42ae-9120-14cf17091411 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.808905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.809534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.809818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.810096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.810757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.812615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f56480-0baf-4dd2-9490-ee08a40932aa admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.813174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.818776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9b60a-0076-4c7f-a731-c4140a0cf378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.819811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b60a-0076-4c7f-a731-c4140a0cf378 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.822697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b60a-0076-4c7f-a731-c4140a0cf378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.823011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9b60a-0076-4c7f-a731-c4140a0cf378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.823818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9b60a-0076-4c7f-a731-c4140a0cf378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.825525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9b60a-0076-4c7f-a731-c4140a0cf378 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.836033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 821/1629] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:39.837098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:39.854245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555430-7fd5-4e3f-bbb8-13b486fd8b6c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:39.859737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 809/1630] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:39.865901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63aaba8-3c54-4a98-ae9c-966723ac4e2c None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.866212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63aaba8-3c54-4a98-ae9c-966723ac4e2c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.866497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63aaba8-3c54-4a98-ae9c-966723ac4e2c None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.868786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:39.869494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:39.870505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 810/1631] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 25 05:13:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:13:39.875516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:39.876231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:39.877363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:39.881567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:39.882273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63aaba8-3c54-4a98-ae9c-966723ac4e2c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:40.282530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 822/1632] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:40.284850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63aaba8-3c54-4a98-ae9c-966723ac4e2c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:40.285346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:40.290061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabc9da-3f44-4e47-8043-de56ff46e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:40.290061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc9da-3f44-4e47-8043-de56ff46e863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.290061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc9da-3f44-4e47-8043-de56ff46e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.290061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabc9da-3f44-4e47-8043-de56ff46e863 admin admin] PATH_INFO: `/v3/projects/9e33504a61d44560a112784694ffd0ee/users/7fa34e7f6f1948e9896a6f24e1b7c6e4/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.290976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50607a3d-dbeb-49bb-9814-48802bb1aff8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:40.291551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabc9da-3f44-4e47-8043-de56ff46e863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e33504a61d44560a112784694ffd0ee, user_id=7fa34e7f6f1948e9896a6f24e1b7c6e4, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:40.291551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabc9da-3f44-4e47-8043-de56ff46e863 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:40.292597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac66ec-1a6e-4df4-b361-69f080d33eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:40.292597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac66ec-1a6e-4df4-b361-69f080d33eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.292597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac66ec-1a6e-4df4-b361-69f080d33eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.292597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac66ec-1a6e-4df4-b361-69f080d33eb1 admin admin] PATH_INFO: `/v3/projects/2304b56d6bf34a17ad42769dab485ac3/users/c14187ee346e42579ca4af2d8d073089/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.293062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 811/1633] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:39 2022] PUT /identity/v3/projects/9e33504a61d44560a112784694ffd0ee/users/7fa34e7f6f1948e9896a6f24e1b7c6e4/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:40.293062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1815-c8a5-4049-b5ce-0bbc55fc33c8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.293062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1815-c8a5-4049-b5ce-0bbc55fc33c8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.293351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac66ec-1a6e-4df4-b361-69f080d33eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2304b56d6bf34a17ad42769dab485ac3, user_id=c14187ee346e42579ca4af2d8d073089, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:40.293458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e1815-c8a5-4049-b5ce-0bbc55fc33c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.293556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac66ec-1a6e-4df4-b361-69f080d33eb1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:40.293650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0b9e1815-c8a5-4049-b5ce-0bbc55fc33c8 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:40.293650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0b9e1815-c8a5-4049-b5ce-0bbc55fc33c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:40.293650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 812/1634] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:13:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:40.293650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e1815-c8a5-4049-b5ce-0bbc55fc33c8 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:40.294140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 823/1635] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:39 2022] PUT /identity/v3/projects/2304b56d6bf34a17ad42769dab485ac3/users/c14187ee346e42579ca4af2d8d073089/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:40.294140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f459a-3a6f-4dee-a28b-fa99e1055304 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.294140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f459a-3a6f-4dee-a28b-fa99e1055304 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.294140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f459a-3a6f-4dee-a28b-fa99e1055304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.394085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-fd4f459a-3a6f-4dee-a28b-fa99e1055304 None None] MFA Rules not processed for user `7fa34e7f6f1948e9896a6f24e1b7c6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:40.398991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fd4f459a-3a6f-4dee-a28b-fa99e1055304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:40.406200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e1815-c8a5-4049-b5ce-0bbc55fc33c8 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:40.533113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:40.534139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.534139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.534687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] PATH_INFO: `/v3/projects/fa1616afc47240d2bb415abfaa40e25d/users/ec9fe23b4e374b5392d5184e161ae50a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.537381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1616afc47240d2bb415abfaa40e25d, user_id=ec9fe23b4e374b5392d5184e161ae50a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:40.540491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:40.540793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:40.558724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 813/1636] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:40 2022] PUT /identity/v3/projects/fa1616afc47240d2bb415abfaa40e25d/users/ec9fe23b4e374b5392d5184e161ae50a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:40.560044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:40.604681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 824/1637] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:40.604681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f459a-3a6f-4dee-a28b-fa99e1055304 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:40.607487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:40.630132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f459a-3a6f-4dee-a28b-fa99e1055304 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:40.669470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f76fd-6532-44e4-baf9-9baf15ecafc7 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:40.680094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:40.684483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.684483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.684483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.730486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfcc9e-b445-45f3-bb6a-5d53fb5a5ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:40.731021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcc9e-b445-45f3-bb6a-5d53fb5a5ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.731417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcc9e-b445-45f3-bb6a-5d53fb5a5ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.732398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcc9e-b445-45f3-bb6a-5d53fb5a5ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.732788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfcc9e-b445-45f3-bb6a-5d53fb5a5ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:40.735003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfcc9e-b445-45f3-bb6a-5d53fb5a5ed5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:40.752963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 825/1638] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:40.755360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db18e-89b0-4436-865b-ebc0f5d00584 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.755709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db18e-89b0-4436-865b-ebc0f5d00584 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.756269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db18e-89b0-4436-865b-ebc0f5d00584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:40.795671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-395db18e-89b0-4436-865b-ebc0f5d00584 None None] MFA Rules not processed for user `ec9fe23b4e374b5392d5184e161ae50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:40.796987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-395db18e-89b0-4436-865b-ebc0f5d00584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:40.874569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:40.875833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:40.896230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 814/1639] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:40.897383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:40.933473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498039-72ae-400b-b5df-a014bee71a8b service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:40.949516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:40.956455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:40.956740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:40.957019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:41.040224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 826/1640] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:41.043573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db18e-89b0-4436-865b-ebc0f5d00584 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:41.070135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db18e-89b0-4436-865b-ebc0f5d00584 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:41.084890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92781e1-6b62-49bd-8c90-3538f7424d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:41.085578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92781e1-6b62-49bd-8c90-3538f7424d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:41.085873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92781e1-6b62-49bd-8c90-3538f7424d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:41.086134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92781e1-6b62-49bd-8c90-3538f7424d28 admin admin] PATH_INFO: `/v3/projects/2304b56d6bf34a17ad42769dab485ac3/users/c14187ee346e42579ca4af2d8d073089/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:41.089396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92781e1-6b62-49bd-8c90-3538f7424d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2304b56d6bf34a17ad42769dab485ac3, user_id=c14187ee346e42579ca4af2d8d073089, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:41.092161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92781e1-6b62-49bd-8c90-3538f7424d28 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:41.125546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 827/1641] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:41 2022] PUT /identity/v3/projects/2304b56d6bf34a17ad42769dab485ac3/users/c14187ee346e42579ca4af2d8d073089/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:41.127019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a79f-a013-4c53-b4a1-091005b5ad4d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:41.127307 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a79f-a013-4c53-b4a1-091005b5ad4d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:41.127584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8a79f-a013-4c53-b4a1-091005b5ad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:41.161761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:41.167675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:41.193058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 815/1642] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:40 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:41.203688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-bda8a79f-a013-4c53-b4a1-091005b5ad4d None None] MFA Rules not processed for user `c14187ee346e42579ca4af2d8d073089`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:41.205757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bda8a79f-a013-4c53-b4a1-091005b5ad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:41.295098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 828/1643] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:41.424982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:41.443527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cff959-c070-488f-90ab-62a9f62cf9b5 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:41.542390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8c17-96d5-40bf-9e2b-2784c9f07244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:41.543138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8c17-96d5-40bf-9e2b-2784c9f07244 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:41.543493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8c17-96d5-40bf-9e2b-2784c9f07244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:41.543844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8c17-96d5-40bf-9e2b-2784c9f07244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:41.655346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a8c17-96d5-40bf-9e2b-2784c9f07244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:41.656848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a8c17-96d5-40bf-9e2b-2784c9f07244 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:41.676665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 816/1644] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:41.882324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8a79f-a013-4c53-b4a1-091005b5ad4d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:41.911958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2481db-5a43-46ad-880f-8d90bb9280d7 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:41.912518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2481db-5a43-46ad-880f-8d90bb9280d7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:41.913145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2481db-5a43-46ad-880f-8d90bb9280d7 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:41.914988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 817/1645] 10.222.0.45 () {54 vars in 962 bytes} [Thu Aug 25 05:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:13:41.920568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8a79f-a013-4c53-b4a1-091005b5ad4d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:41.926885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b795f-af8e-428e-a58d-9a0c785e13dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:41.930725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b795f-af8e-428e-a58d-9a0c785e13dc service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:41.931028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b795f-af8e-428e-a58d-9a0c785e13dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:41.931303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b795f-af8e-428e-a58d-9a0c785e13dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:41.934151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9158-c21c-4ad5-9f12-ebd9cc8c7e10 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:41.934442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9158-c21c-4ad5-9f12-ebd9cc8c7e10 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:41.934726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a9158-c21c-4ad5-9f12-ebd9cc8c7e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:41.982323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b795f-af8e-428e-a58d-9a0c785e13dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:41.984178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b795f-af8e-428e-a58d-9a0c785e13dc service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:41.990629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-344a9158-c21c-4ad5-9f12-ebd9cc8c7e10 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:41.994717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-344a9158-c21c-4ad5-9f12-ebd9cc8c7e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:42.015927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 829/1646] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:42.260980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 818/1647] 10.222.0.45 () {58 vars in 1059 bytes} [Thu Aug 25 05:13:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:42.262549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127953-3874-4b07-bb40-a41f23e992d3 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:42.265851 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127953-3874-4b07-bb40-a41f23e992d3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:42.267275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec127953-3874-4b07-bb40-a41f23e992d3 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:42.268457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 830/1648] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 25 05:13:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:13:42.284516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965eca-29b9-4ff1-b82b-55604238b1d7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:42.286199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965eca-29b9-4ff1-b82b-55604238b1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:42.286199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac965eca-29b9-4ff1-b82b-55604238b1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:42.351960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ac965eca-29b9-4ff1-b82b-55604238b1d7 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:42.353461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ac965eca-29b9-4ff1-b82b-55604238b1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:42.401020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 819/1649] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:13:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:42.597370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127953-3874-4b07-bb40-a41f23e992d3 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:42.621464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec127953-3874-4b07-bb40-a41f23e992d3 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:42.638163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:42.639383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:42.639674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:42.640032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:42.703755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:42.703755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:42.755014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 831/1650] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:42.905217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:42.915211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac965eca-29b9-4ff1-b82b-55604238b1d7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:42.916858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:42.928624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699cffa-aa2e-4ecc-8676-755824c69d08 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:42.940390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790864d5-cc5f-4c86-a7c5-e30f4b98de66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:42.950368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790864d5-cc5f-4c86-a7c5-e30f4b98de66 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:42.950368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790864d5-cc5f-4c86-a7c5-e30f4b98de66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:42.950368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790864d5-cc5f-4c86-a7c5-e30f4b98de66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:43.072495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:43.092028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac965eca-29b9-4ff1-b82b-55604238b1d7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:43.114922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:43.115589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:43.115870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:43.116175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] PATH_INFO: `/v3/users/1750872eb90141f9be755b57268204c2` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:43.118552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1750872eb90141f9be755b57268204c2)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:43.124296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: WARNING py.warnings [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:13:43.124296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: warnings.warn(msg) Aug 25 05:13:43.124296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: Aug 25 05:13:43.125579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:43.149524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790864d5-cc5f-4c86-a7c5-e30f4b98de66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:43.162215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790864d5-cc5f-4c86-a7c5-e30f4b98de66 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:43.185626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 832/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:43.627737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1750872eb90141f9be755b57268204c2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:43.631310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1750872eb90141f9be755b57268204c2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:43.632456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1750872eb90141f9be755b57268204c2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:43.779751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1750872eb90141f9be755b57268204c2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:43.835719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1750872eb90141f9be755b57268204c2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:43.945289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 820/1652] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:42 2022] DELETE /identity/v3/users/1750872eb90141f9be755b57268204c2 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:43.950836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:43.951796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:43.952483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:44.001435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:44.006168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:44.170632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 833/1653] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:13:44.232590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:44.235322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:44.425178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21269-c376-4345-a190-23420c85dde0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:44.438803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27616e8-2cc2-4cef-869f-6c16a9b3c028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:44.439763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27616e8-2cc2-4cef-869f-6c16a9b3c028 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:44.440357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27616e8-2cc2-4cef-869f-6c16a9b3c028 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:44.440700 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27616e8-2cc2-4cef-869f-6c16a9b3c028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:44.470278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27616e8-2cc2-4cef-869f-6c16a9b3c028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:44.472022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27616e8-2cc2-4cef-869f-6c16a9b3c028 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:44.512825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 821/1654] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:45.332653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:45.420156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:45.534385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:45.534385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:45.560020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32209a-be16-406f-ab61-d53668af27e8 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:45.570728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:45.571771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:45.574218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:45.574518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] PATH_INFO: `/v3/users/acb4017165a64636a4e08478fb682bf4` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:45.575765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb4017165a64636a4e08478fb682bf4)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:45.577817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:45.882101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb4017165a64636a4e08478fb682bf4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:45.906288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb4017165a64636a4e08478fb682bf4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:45.908366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb4017165a64636a4e08478fb682bf4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:45.980382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb4017165a64636a4e08478fb682bf4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:45.999757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb4017165a64636a4e08478fb682bf4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.018853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 834/1655] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:45 2022] DELETE /identity/v3/users/acb4017165a64636a4e08478fb682bf4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:46.028895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:46.028895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:46.028895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:46.053761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:46.055245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:46.175288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 822/1656] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:13:46.219319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:46.221250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:46.407340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eaefa-0fc1-4d62-bf9e-684cfde2a5be admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:46.423056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:46.423519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:46.424179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:46.427283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:46.456219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:46.462227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:46.464044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:46.478271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:46.495417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b02c3-2a5a-4619-b4c2-4ba0b8269137 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:46.519688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:46.520923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:46.521573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:46.521573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] PATH_INFO: `/v3/projects/50f335a94e2d498486a6366dde18f148` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:46.522357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 835/1657] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:46.522724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f335a94e2d498486a6366dde18f148)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:46.524935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:46.549603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:46.555983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:46.603738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4c234-9a2c-4013-911a-6dfb6f703f56 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:46.631754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:46.632448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:46.632720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:46.632995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] PATH_INFO: `/v3/users/ebec583ec90b4d819aa92b23f4b35653` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:46.634409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebec583ec90b4d819aa92b23f4b35653)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:46.642780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:46.733436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:46.823938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f335a94e2d498486a6366dde18f148', 'request_id': 'req-548c1709-b8ab-4ec2-a623-9891010a0425'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.845711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f335a94e2d498486a6366dde18f148', 'request_id': 'req-548c1709-b8ab-4ec2-a623-9891010a0425'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.939293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebec583ec90b4d819aa92b23f4b35653'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.957888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f335a94e2d498486a6366dde18f148', 'request_id': 'req-548c1709-b8ab-4ec2-a623-9891010a0425'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.966893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebec583ec90b4d819aa92b23f4b35653'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.968051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebec583ec90b4d819aa92b23f4b35653'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.984171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] The token cache is being invalidate because project 50f335a94e2d498486a6366dde18f148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:13:46.984626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.985465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:46.987612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 823/1658] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:46 2022] DELETE /identity/v3/projects/50f335a94e2d498486a6366dde18f148 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:13:46.992305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:46.997294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:47.088650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebec583ec90b4d819aa92b23f4b35653'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:47.091505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c1709-b8ab-4ec2-a623-9891010a0425 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:47.097805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8befa020-6858-4423-a86e-43d3fceb9db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebec583ec90b4d819aa92b23f4b35653'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:47.100049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:47.101259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:47.101680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:47.102283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] PATH_INFO: `/v3/users/7fa34e7f6f1948e9896a6f24e1b7c6e4` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:47.115240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa34e7f6f1948e9896a6f24e1b7c6e4)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:47.115240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:47.118918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 836/1659] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:46 2022] DELETE /identity/v3/users/ebec583ec90b4d819aa92b23f4b35653 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:13:47.123724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243779c-e4f4-4d2b-af66-ef35b5947fc3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:47.124048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243779c-e4f4-4d2b-af66-ef35b5947fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:47.124326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243779c-e4f4-4d2b-af66-ef35b5947fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:47.161334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-6243779c-e4f4-4d2b-af66-ef35b5947fc3 None None] MFA Rules not processed for user `9ab8473b2bcf4a2f80d990ee39aac517`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:47.163006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6243779c-e4f4-4d2b-af66-ef35b5947fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:47.303963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 837/1660] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:47.305913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd1b0b-46d0-4cf9-9076-737a0a418104 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:47.306529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd1b0b-46d0-4cf9-9076-737a0a418104 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:47.306933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd1b0b-46d0-4cf9-9076-737a0a418104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:47.375639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7acd1b0b-46d0-4cf9-9076-737a0a418104 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:47.378756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7acd1b0b-46d0-4cf9-9076-737a0a418104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:47.432830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa34e7f6f1948e9896a6f24e1b7c6e4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:47.435775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa34e7f6f1948e9896a6f24e1b7c6e4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:47.436756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa34e7f6f1948e9896a6f24e1b7c6e4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:47.540776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa34e7f6f1948e9896a6f24e1b7c6e4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:47.556846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa34e7f6f1948e9896a6f24e1b7c6e4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:47.582475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 838/1661] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:47.597985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:47.597985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:47.597985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:47.600304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 824/1662] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:46 2022] DELETE /identity/v3/users/7fa34e7f6f1948e9896a6f24e1b7c6e4 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:47.601207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:47.604012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:47.632665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] MFA Rules not processed for user `9ab8473b2bcf4a2f80d990ee39aac517`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:47.632665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:47.724383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 839/1663] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:47.738999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:47.744535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:47.757951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:47.808625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ffa97-d02e-4cbf-8e07-61f987fe1241 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:47.816601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:47.817304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:47.817569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:47.817844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:47.906530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:47.910856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:47.925515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 825/1664] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:47.995271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd8e06-c5a5-4e27-badb-7cfacd1d5f0a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:48.017457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:48.018923 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:48.019717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:48.021031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:48.024672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:48.050834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:48.053052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:48.086704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 840/1665] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:48.245184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:48.246975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:48.280104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52100a-dc55-4bc3-b538-4a1baafdfb0c service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:48.299522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:48.300335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:48.300823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:48.301436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] PATH_INFO: `/v3/projects/726e0b4b3e824822a909717d8b47d32c` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:48.308140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726e0b4b3e824822a909717d8b47d32c)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:48.310367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:48.525639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726e0b4b3e824822a909717d8b47d32c', 'request_id': 'req-463fb9d5-d876-4fdf-940c-5e7abb27a513'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:48.554395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726e0b4b3e824822a909717d8b47d32c', 'request_id': 'req-463fb9d5-d876-4fdf-940c-5e7abb27a513'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:48.672215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726e0b4b3e824822a909717d8b47d32c', 'request_id': 'req-463fb9d5-d876-4fdf-940c-5e7abb27a513'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:48.690815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] The token cache is being invalidate because project 726e0b4b3e824822a909717d8b47d32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:13:48.691123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:48.696207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-463fb9d5-d876-4fdf-940c-5e7abb27a513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:48.701765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 826/1666] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:48 2022] DELETE /identity/v3/projects/726e0b4b3e824822a909717d8b47d32c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:48.703171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:48.740264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0d2ac-4976-4aef-8c30-3b0338205fc6 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:48.912865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:48.913532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:48.913822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:48.914098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] PATH_INFO: `/v3/users/ec9fe23b4e374b5392d5184e161ae50a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:48.915343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9fe23b4e374b5392d5184e161ae50a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:48.917403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:48.945336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:48.969023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:49.235883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9fe23b4e374b5392d5184e161ae50a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:49.288749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9fe23b4e374b5392d5184e161ae50a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:49.291849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9fe23b4e374b5392d5184e161ae50a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:49.437309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9fe23b4e374b5392d5184e161ae50a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:49.450384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-31170919-937a-4cc6-8581-6fa52d1de74a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9fe23b4e374b5392d5184e161ae50a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:49.478738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 841/1667] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:48 2022] DELETE /identity/v3/users/ec9fe23b4e374b5392d5184e161ae50a => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:49.668578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb8f29-2884-441a-ba81-4fd6e0d7cc44 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:49.669138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb8f29-2884-441a-ba81-4fd6e0d7cc44 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:49.669138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb8f29-2884-441a-ba81-4fd6e0d7cc44 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:49.670963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 827/1668] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 25 05:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:13:49.684530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:49.685085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:49.685552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:49.812395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] MFA Rules not processed for user `3819d2b7da64494f9ed77f670b7c23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:49.813788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:49.983352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:49.983648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:49.986636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:49.994414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 842/1669] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:13:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:13:50.033802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:50.036157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:50.058123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd66e7-4865-4d58-ab99-bf0fda0c1acf None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:50.068759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:50.069649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:50.070120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:50.070739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:50.092503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:50.094256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:50.118273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] MFA Rules not processed for user `86fd818c1f894c388de9ca49c39a8cde`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:50.120848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 843/1670] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:50.121041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:50.139618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:50.141299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:50.407713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 828/1671] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:50.407949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f7d25-97b6-4937-b132-e198066870db service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:50.426957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:50.428263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:50.428883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:50.429471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] PATH_INFO: `/v3/projects/519a586812c5441ab148590e1bfe9ea9` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:50.430912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:50.432492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:50.434212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=519a586812c5441ab148590e1bfe9ea9)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:50.439257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: WARNING py.warnings [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 05:13:50.439257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: warnings.warn(msg) Aug 25 05:13:50.439257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: Aug 25 05:13:50.443000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:50.570569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d599-9365-48da-9c73-a2b5b8764b6f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:50.577661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:50.578289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:50.578590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:50.578911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:50.588478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:50.590414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:50.617967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 829/1672] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:50.625124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:50.626638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:50.671867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95f073-60ee-4fbe-b2f2-eea2f6c4522c service nova] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:50.727772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519a586812c5441ab148590e1bfe9ea9', 'request_id': 'req-d22e1574-6986-49a7-9cf2-32bd143f1a9b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:50.770204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519a586812c5441ab148590e1bfe9ea9', 'request_id': 'req-d22e1574-6986-49a7-9cf2-32bd143f1a9b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:50.846476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:50.849857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:50.849857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:50.849857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] PATH_INFO: `/v3/projects/9e33504a61d44560a112784694ffd0ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:50.850943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e33504a61d44560a112784694ffd0ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:50.856848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:50.909816 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519a586812c5441ab148590e1bfe9ea9', 'request_id': 'req-d22e1574-6986-49a7-9cf2-32bd143f1a9b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:50.942840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] The token cache is being invalidate because project 519a586812c5441ab148590e1bfe9ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:13:50.944248 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:50.966074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:50.974795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 844/1673] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:50 2022] DELETE /identity/v3/projects/519a586812c5441ab148590e1bfe9ea9 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:50.978829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:50.982017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:51.053555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e1574-6986-49a7-9cf2-32bd143f1a9b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:51.076238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e33504a61d44560a112784694ffd0ee', 'request_id': 'req-c3f2169f-00e3-4e44-9afe-170aef392915'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.090906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e33504a61d44560a112784694ffd0ee', 'request_id': 'req-c3f2169f-00e3-4e44-9afe-170aef392915'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.225625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e33504a61d44560a112784694ffd0ee', 'request_id': 'req-c3f2169f-00e3-4e44-9afe-170aef392915'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.254930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] The token cache is being invalidate because project 9e33504a61d44560a112784694ffd0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:13:51.255228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.256368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c3f2169f-00e3-4e44-9afe-170aef392915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.262422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 830/1674] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:50 2022] DELETE /identity/v3/projects/9e33504a61d44560a112784694ffd0ee => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:13:51.268185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:51.269372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa059c-fbdd-4b86-9965-b69cff66bf12 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.271509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa059c-fbdd-4b86-9965-b69cff66bf12 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.271736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.272192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa059c-fbdd-4b86-9965-b69cff66bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.272940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.275457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] PATH_INFO: `/v3/projects/fa1616afc47240d2bb415abfaa40e25d` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.279815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1616afc47240d2bb415abfaa40e25d)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:51.283114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:51.351799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-78aa059c-fbdd-4b86-9965-b69cff66bf12 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:51.354504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-78aa059c-fbdd-4b86-9965-b69cff66bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:51.390022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 831/1675] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:51.391463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a8f9-17f2-471b-ba7f-d482384109b8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.391756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a8f9-17f2-471b-ba7f-d482384109b8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.392089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582a8f9-17f2-471b-ba7f-d482384109b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.471094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1616afc47240d2bb415abfaa40e25d', 'request_id': 'req-9a5b3aa3-6738-4994-b031-62d1488c0257'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.484512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1616afc47240d2bb415abfaa40e25d', 'request_id': 'req-9a5b3aa3-6738-4994-b031-62d1488c0257'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.487796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-1582a8f9-17f2-471b-ba7f-d482384109b8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:51.489278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1582a8f9-17f2-471b-ba7f-d482384109b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:51.599238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1616afc47240d2bb415abfaa40e25d', 'request_id': 'req-9a5b3aa3-6738-4994-b031-62d1488c0257'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.656375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] The token cache is being invalidate because project fa1616afc47240d2bb415abfaa40e25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:13:51.661708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.661708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9a5b3aa3-6738-4994-b031-62d1488c0257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:51.668809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 845/1676] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:50 2022] DELETE /identity/v3/projects/fa1616afc47240d2bb415abfaa40e25d => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:51.672014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f18254-9694-440f-aed2-9998977cce17 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.673585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f18254-9694-440f-aed2-9998977cce17 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.689437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f18254-9694-440f-aed2-9998977cce17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.753263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 832/1677] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:51.755007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187509d2-55d5-4824-98f9-66a80301369b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.755350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187509d2-55d5-4824-98f9-66a80301369b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.755633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187509d2-55d5-4824-98f9-66a80301369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.782898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-95f18254-9694-440f-aed2-9998977cce17 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:51.796142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-95f18254-9694-440f-aed2-9998977cce17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:51.808095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-187509d2-55d5-4824-98f9-66a80301369b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:51.815426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-187509d2-55d5-4824-98f9-66a80301369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:51.838963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 833/1678] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:51.843022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e48bd-51ed-4c2a-ab92-b8fa6eeae4d4 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.843609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 846/1679] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:51.843834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e48bd-51ed-4c2a-ab92-b8fa6eeae4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.844180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e48bd-51ed-4c2a-ab92-b8fa6eeae4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.847054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c648-e245-46d8-b43c-783b90d102f7 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.847773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c648-e245-46d8-b43c-783b90d102f7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.848316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c648-e245-46d8-b43c-783b90d102f7 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.850033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 847/1680] 10.222.0.45 () {54 vars in 961 bytes} [Thu Aug 25 05:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:13:51.851133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c648-e245-46d8-b43c-783b90d102f7 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:51.899749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-006e48bd-51ed-4c2a-ab92-b8fa6eeae4d4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:51.901211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-006e48bd-51ed-4c2a-ab92-b8fa6eeae4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:51.922502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c648-e245-46d8-b43c-783b90d102f7 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:51.926682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 834/1681] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:51.930471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfb0f-3ec8-4bfd-8a58-c0147114cd0c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.930958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfb0f-3ec8-4bfd-8a58-c0147114cd0c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.932732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bfb0f-3ec8-4bfd-8a58-c0147114cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.944994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:51.955327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fd707-4065-47f5-b5d5-26636d34cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:51.956360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd707-4065-47f5-b5d5-26636d34cf6a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:51.957014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd707-4065-47f5-b5d5-26636d34cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:51.957660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fd707-4065-47f5-b5d5-26636d34cf6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:51.958653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd707-4065-47f5-b5d5-26636d34cf6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:51.959163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd707-4065-47f5-b5d5-26636d34cf6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:51.961212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fd707-4065-47f5-b5d5-26636d34cf6a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.018972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2b3bfb0f-3ec8-4bfd-8a58-c0147114cd0c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:52.020629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2b3bfb0f-3ec8-4bfd-8a58-c0147114cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:52.037096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 848/1682] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:52.038599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c00b-1ff6-45b1-a0a9-81795ef8e2b8 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.040351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c00b-1ff6-45b1-a0a9-81795ef8e2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.044289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4c00b-1ff6-45b1-a0a9-81795ef8e2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.067193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 835/1683] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:52.068153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfb0f-3ec8-4bfd-8a58-c0147114cd0c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.098153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bfb0f-3ec8-4bfd-8a58-c0147114cd0c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.107046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3da4c00b-1ff6-45b1-a0a9-81795ef8e2b8 None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:52.109145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3da4c00b-1ff6-45b1-a0a9-81795ef8e2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:52.123817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.124517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.124796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.125064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.125730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:52.126034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.129684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.188357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 836/1684] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:52.204016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:52.205942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.228457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6019e-ec35-47ff-b746-b9c102427e30 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.243028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.244936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.247527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.247818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.252374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.262237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.350256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 849/1685] 10.222.0.45 () {58 vars in 1058 bytes} [Thu Aug 25 05:13:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:52.351403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4c00b-1ff6-45b1-a0a9-81795ef8e2b8 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.364356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4c00b-1ff6-45b1-a0a9-81795ef8e2b8 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.370010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.371336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.371989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.372473 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.376245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:52.376734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.379863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.389070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 837/1686] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:52 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:52.389930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.408341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 850/1687] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:52.411542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.445219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438278-47fc-4418-b922-4930b26dfff8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.549195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549216b-26f7-4c01-9673-91ddc0b3e573 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.564594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.567555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.567740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.569247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.569984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.576813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.620593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.621503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.621945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.622398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.624857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:52.645255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.647880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.667394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 851/1688] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:52.670857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.712573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 838/1689] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:52 2022] POST /identity/v3/projects => generated 371 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:52.713444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.719853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241a33-ecd4-4608-8d5a-c3afa22af664 service placement] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.793104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.793104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.793104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.793104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.793417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.795240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.904145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4b35f-71b0-4089-b0a0-569f49088631 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.918884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 852/1690] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:52 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:52.920081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:52.937601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.938610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.939173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.939549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.940959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.947316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:52.951640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05213ec0-6f10-4171-83ed-ebdffe67f49b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:52.963275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:52.965003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:52.965474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:52.966155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:52.967044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:52.969228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.060770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 839/1691] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:52 2022] POST /identity/v3/projects => generated 377 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:53.062111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.071867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:53.088220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 853/1692] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:52 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:53.089643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.150837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638c016-19c3-4d18-bfae-133d23c43397 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.240036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f07e21-7254-43ba-a8e7-bf387308bb7c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.251373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.252549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.254759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.256005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.258560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.260576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.279951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 840/1693] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:53.283515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.299746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94557f3d-4432-4f61-a283-895d59b35079 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.307422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.308391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.308795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.309185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.310130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.312186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.319503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.320418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.320898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.321363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.324605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.324721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 841/1694] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:53.325808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.327405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.345623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8926b5-129e-46e0-949e-29ac2d71d599 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.351857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.353632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.354098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.354472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.355819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.357794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.387799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 842/1695] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:53.388957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.409596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf2e05-6988-4c7a-93bd-23c9b32f2203 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.428606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.429343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.429695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.430038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.430916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.432678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.451156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 843/1696] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:53.452427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.463286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85982946-aa25-4632-8c70-312ced115bca admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.479688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 854/1697] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:53 2022] POST /identity/v3/users => generated 289 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:53.479688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.484355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ce3c8-c766-4bbd-9ae0-3ac1f25277a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.484355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ce3c8-c766-4bbd-9ae0-3ac1f25277a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.484355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ce3c8-c766-4bbd-9ae0-3ac1f25277a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.487743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ce3c8-c766-4bbd-9ae0-3ac1f25277a2 admin admin] PATH_INFO: `/v3/projects/b272cfd1714a4fd198cbb68f62f098f5/users/8ddea587c6c94990880818ec1419083d/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.500428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6fa34-b20e-44e5-80c3-fccbab167ddf admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.515530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.516322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.516691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.517407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] PATH_INFO: `/v3/projects/9dd62e2da02d4e80800b7944ae42f596/users/adfbfd2a39dd4f3ca9c1b3e041088800/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.531792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ce3c8-c766-4bbd-9ae0-3ac1f25277a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b272cfd1714a4fd198cbb68f62f098f5, user_id=8ddea587c6c94990880818ec1419083d, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.534562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ce3c8-c766-4bbd-9ae0-3ac1f25277a2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.540774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd62e2da02d4e80800b7944ae42f596, user_id=adfbfd2a39dd4f3ca9c1b3e041088800, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.545467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.701566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 855/1698] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:53 2022] PUT /identity/v3/projects/9dd62e2da02d4e80800b7944ae42f596/users/adfbfd2a39dd4f3ca9c1b3e041088800/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:53.701566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:53.711297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 844/1699] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:53 2022] PUT /identity/v3/projects/b272cfd1714a4fd198cbb68f62f098f5/users/8ddea587c6c94990880818ec1419083d/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:53.726690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4fc1-aa86-4181-92f6-2d2538fa4c97 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.731945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4fc1-aa86-4181-92f6-2d2538fa4c97 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.732226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac4fc1-aa86-4181-92f6-2d2538fa4c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.844036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6fac4fc1-aa86-4181-92f6-2d2538fa4c97 None None] MFA Rules not processed for user `e8776ca5fe264cee904f8fab1a16a5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:53.845629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6fac4fc1-aa86-4181-92f6-2d2538fa4c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:53.883268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d8e0-49d9-4506-a469-6c7326761cd6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:53.956216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2bcfb8-683c-4a05-adde-cb58d22fc5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:53.957010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bcfb8-683c-4a05-adde-cb58d22fc5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.958009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bcfb8-683c-4a05-adde-cb58d22fc5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.958467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bcfb8-683c-4a05-adde-cb58d22fc5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.959294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bcfb8-683c-4a05-adde-cb58d22fc5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:53.961328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2bcfb8-683c-4a05-adde-cb58d22fc5cf admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:53.977515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 845/1700] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:53.979680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:53.980254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:53.980726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:53.995629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 856/1701] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:54.000526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bb52-1cd0-4ca7-8ea6-7ce1dc17e440 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.000526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bb52-1cd0-4ca7-8ea6-7ce1dc17e440 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.000526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bb52-1cd0-4ca7-8ea6-7ce1dc17e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.042885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] MFA Rules not processed for user `adfbfd2a39dd4f3ca9c1b3e041088800`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:54.045007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:54.053722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8d51bb52-1cd0-4ca7-8ea6-7ce1dc17e440 None None] MFA Rules not processed for user `8ddea587c6c94990880818ec1419083d`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:54.056387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8d51bb52-1cd0-4ca7-8ea6-7ce1dc17e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:54.141601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 846/1702] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:54.142755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:54.144481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:54.183302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 857/1703] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:54.184229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51bb52-1cd0-4ca7-8ea6-7ce1dc17e440 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:54.200184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51bb52-1cd0-4ca7-8ea6-7ce1dc17e440 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:54.221549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:54.222788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.223213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.223671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.225065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:54.227148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:54.241365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 858/1704] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:54.242653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:54.247574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944d240-87d3-4ab6-92d1-23e53699ca1b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:54.258670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:54.259616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.264304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.264304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.273764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:54.276541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:54.282339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dee9d1-6562-4143-b3d3-f042939c9ad0 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:54.290769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 847/1705] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:54.292335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:54.295342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:54.298002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:54.298743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.298944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.299373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.300178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:54.307346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:54.335110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d7ef2-2842-4e0a-a478-b49d97cf50e3 service nova] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:54.351224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:54.352387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.352879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.353597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.375806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:54.378268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:54.403861 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 848/1706] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:54.408160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:54.451191 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4ad4-c631-40be-9bbf-97b0fac9ceac service nova] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:54.455640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 859/1707] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:54 2022] POST /identity/v3/projects => generated 369 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:54.457735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:54.645533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11c370-9a99-424e-8c9f-e8049e8eb8e4 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:54.664621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:54.667098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.668638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.669616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3431dd0-8178-4f66-be37-7eade18f3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:54.670017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.670466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431dd0-8178-4f66-be37-7eade18f3bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.670853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431dd0-8178-4f66-be37-7eade18f3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.671129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3431dd0-8178-4f66-be37-7eade18f3bbb admin admin] PATH_INFO: `/v3/projects/94e3e8506ca64e0c9e679556365dc78a/users/e5520a6ebb54401581f1e0c6f68249f3/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.671283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:54.677260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:54.727542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3431dd0-8178-4f66-be37-7eade18f3bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e3e8506ca64e0c9e679556365dc78a, user_id=e5520a6ebb54401581f1e0c6f68249f3, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:54.732347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3431dd0-8178-4f66-be37-7eade18f3bbb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:54.751873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:54.867256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 849/1708] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:54 2022] PUT /identity/v3/projects/94e3e8506ca64e0c9e679556365dc78a/users/e5520a6ebb54401581f1e0c6f68249f3/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:54.877719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:54.877999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:54.878435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:54.894041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 860/1709] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:54 2022] POST /identity/v3/users => generated 291 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:54.896303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:54.922917 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579716df-186f-480b-9302-d936abbc7599 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:54.951606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] MFA Rules not processed for user `e5520a6ebb54401581f1e0c6f68249f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:54.953200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:55.083563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:55.084435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:55.084773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:55.085408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:55.086294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:55.088500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 850/1710] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:55.090103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:55.092470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:55.094641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:55.124843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 861/1711] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:13:55.126278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:55.153201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f356ce-7c77-4575-b1f1-df68f57222da admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:55.161107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0634a97-c82c-4465-8bce-2cf27e0d73e5 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:55.166464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:55.167555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:55.168084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:55.168592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] PATH_INFO: `/v3/users/8ddea587c6c94990880818ec1419083d` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:55.170028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddea587c6c94990880818ec1419083d)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:55.177950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:55.178275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:55.179158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:55.179583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:55.180058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] PATH_INFO: `/v3/users/bbc5cc50796841ffbcf8214a11810bee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:55.181428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc5cc50796841ffbcf8214a11810bee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:55.185329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:55.405438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:55.477834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddea587c6c94990880818ec1419083d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.495873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc5cc50796841ffbcf8214a11810bee'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.497522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc5cc50796841ffbcf8214a11810bee'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.498816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc5cc50796841ffbcf8214a11810bee'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.517179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddea587c6c94990880818ec1419083d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.520495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddea587c6c94990880818ec1419083d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.581543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc5cc50796841ffbcf8214a11810bee'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.596128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc5cc50796841ffbcf8214a11810bee'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.663361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 851/1712] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:55 2022] DELETE /identity/v3/users/bbc5cc50796841ffbcf8214a11810bee => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:55.665070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:55.669240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:55.729928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddea587c6c94990880818ec1419083d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.756675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddea587c6c94990880818ec1419083d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:55.775639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 862/1713] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:55 2022] DELETE /identity/v3/users/8ddea587c6c94990880818ec1419083d => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:55.778674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:55.780524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:55.876663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d52214-42f2-4e84-901b-584eea257f7a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:55.888512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd51650-02e0-4b5b-a0de-8476c72ca890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:55.889804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51650-02e0-4b5b-a0de-8476c72ca890 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:55.890385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51650-02e0-4b5b-a0de-8476c72ca890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:55.891063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51650-02e0-4b5b-a0de-8476c72ca890 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:55.891952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd51650-02e0-4b5b-a0de-8476c72ca890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:55.894444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd51650-02e0-4b5b-a0de-8476c72ca890 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:55.903660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20a0e-eb4d-465d-a354-c2be01d4a58d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:55.917535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c147f-106c-4c18-998f-3f736fc098a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:55.918381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c147f-106c-4c18-998f-3f736fc098a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:55.918771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c147f-106c-4c18-998f-3f736fc098a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:55.919227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c147f-106c-4c18-998f-3f736fc098a5 admin admin] PATH_INFO: `/v3/projects/0873e43db9a94476b8f74afc0aad99ae/users/70c60b49002f4ca0af0860de7ec83282/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:55.937831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c147f-106c-4c18-998f-3f736fc098a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0873e43db9a94476b8f74afc0aad99ae, user_id=70c60b49002f4ca0af0860de7ec83282, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:55.940989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c147f-106c-4c18-998f-3f736fc098a5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.006697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 852/1714] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:55 2022] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:56.008176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df17bb-491b-4795-a8eb-3b0a008271ad None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.008495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df17bb-491b-4795-a8eb-3b0a008271ad None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.008773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df17bb-491b-4795-a8eb-3b0a008271ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.034205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e0df17bb-491b-4795-a8eb-3b0a008271ad None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:56.036779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e0df17bb-491b-4795-a8eb-3b0a008271ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.041577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 863/1715] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:55 2022] PUT /identity/v3/projects/0873e43db9a94476b8f74afc0aad99ae/users/70c60b49002f4ca0af0860de7ec83282/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:56.043187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.043644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.045164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.081232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] MFA Rules not processed for user `86fd818c1f894c388de9ca49c39a8cde`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:56.082612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.131098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 853/1716] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:56.133931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.136353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.136834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.166591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:56.168318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.171419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 864/1717] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:56.179023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.180801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.182304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 854/1718] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:56.183284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.184925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.196841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a5e08-5df6-4dd8-8a01-6bab71fba2e1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.204710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577667dc-d920-49a2-ae2e-0c019ed28e59 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.204887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:56.206417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.206710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.207053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] PATH_INFO: `/v3/users/64fdf82f1b6144fc839b947878a81ea5` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.208860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fdf82f1b6144fc839b947878a81ea5)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:56.214860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.219160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:56.220139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.220496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.220882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.221674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:56.226196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.330906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 855/1719] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:56 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:56.332680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.345701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8e6f5-37c8-451d-bda2-a65b754f90d2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.352613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:56.353323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.353610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.353887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.354664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:56.361135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.377063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 856/1720] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:56.381965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.383863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.483943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fdf82f1b6144fc839b947878a81ea5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:56.484224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224748e0-84eb-4061-92c1-feca3b829eb2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.493434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:56.494771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.496871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.497388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.500471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fdf82f1b6144fc839b947878a81ea5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:56.501199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fdf82f1b6144fc839b947878a81ea5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:56.518187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:56.520621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.532365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 857/1721] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:56.533263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.535257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.563205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4937-576c-4d03-95b4-0ccabbb3199e service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.572076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:56.573996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.574593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.575091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.591040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:56.593312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.609701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 858/1722] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:56.611145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.618557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fdf82f1b6144fc839b947878a81ea5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:56.623652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1510a7c-6c3b-49ef-bc30-106fe124b1ef service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.629652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fdf82f1b6144fc839b947878a81ea5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:56.633685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec46e4-ce8e-4e6e-b9d1-9282780996fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:56.633685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec46e4-ce8e-4e6e-b9d1-9282780996fa admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.633685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec46e4-ce8e-4e6e-b9d1-9282780996fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.633976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec46e4-ce8e-4e6e-b9d1-9282780996fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.634605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec46e4-ce8e-4e6e-b9d1-9282780996fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:56.636944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec46e4-ce8e-4e6e-b9d1-9282780996fa admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.638136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 865/1723] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:13:56 2022] DELETE /identity/v3/users/64fdf82f1b6144fc839b947878a81ea5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:56.640346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.642119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.658896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 859/1724] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:56.658896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.658896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.658896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.684250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:56.685496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.815707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7e1a3-a087-4863-b8f2-9942a398989a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.833230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf0841-233f-4033-a45b-ec782f2bcc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:56.834321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0841-233f-4033-a45b-ec782f2bcc51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.834705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0841-233f-4033-a45b-ec782f2bcc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.835154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf0841-233f-4033-a45b-ec782f2bcc51 admin admin] PATH_INFO: `/v3/projects/0873e43db9a94476b8f74afc0aad99ae/users/70c60b49002f4ca0af0860de7ec83282/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.836771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 860/1725] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:56.837748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:56.839246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0841-233f-4033-a45b-ec782f2bcc51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0873e43db9a94476b8f74afc0aad99ae, user_id=70c60b49002f4ca0af0860de7ec83282, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:56.839357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:56.848885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cf0841-233f-4033-a45b-ec782f2bcc51 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:56.870378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c991359-e672-4e87-accc-bc08abe6cf92 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:56.883813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 866/1726] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:56 2022] PUT /identity/v3/projects/0873e43db9a94476b8f74afc0aad99ae/users/70c60b49002f4ca0af0860de7ec83282/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:56.895577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:56.895926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:56.896409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:56.962276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] MFA Rules not processed for user `70c60b49002f4ca0af0860de7ec83282`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:56.963936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:57.049736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:57.051692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.052878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.053170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] PATH_INFO: `/v3/projects/d02df540db4b485591ec1a144690a452/users/5a585cdae49745859aeaa9667ef3e37a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.091446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02df540db4b485591ec1a144690a452, user_id=5a585cdae49745859aeaa9667ef3e37a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:57.095760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:57.135982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 867/1727] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:57.137283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:57.139618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:57.235096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ae3d4-20e2-4732-9be8-09cd488bf73b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:57.243667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 861/1728] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:56 2022] PUT /identity/v3/projects/d02df540db4b485591ec1a144690a452/users/5a585cdae49745859aeaa9667ef3e37a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:57.243667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:57.249892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:57.328804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:57.329431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.329709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.329978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.429288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188d13c-0912-49ac-b151-e03a527d8e72 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:57.441811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:57.443243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.443763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.444504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.444893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:57.447560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:57.471110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 868/1729] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:57.471986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:57.484647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b9b5-2729-43fb-9a88-59b71acef57b service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:57.491739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:57.492411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.492693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.492971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.493635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:57.495369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:57.512751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 869/1730] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:13:57.513914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:57.526814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a65381-96a9-40cb-90ac-199dcaaf333c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:57.538140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66b129-646f-4840-bdbd-7f0f5029c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:57.538998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b129-646f-4840-bdbd-7f0f5029c860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.539382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b129-646f-4840-bdbd-7f0f5029c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.539735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66b129-646f-4840-bdbd-7f0f5029c860 admin admin] PATH_INFO: `/v3/projects/d02df540db4b485591ec1a144690a452/users/5a585cdae49745859aeaa9667ef3e37a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.542633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66b129-646f-4840-bdbd-7f0f5029c860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02df540db4b485591ec1a144690a452, user_id=5a585cdae49745859aeaa9667ef3e37a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:57.546105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66b129-646f-4840-bdbd-7f0f5029c860 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:57.575441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:57.576260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 870/1731] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:13:57 2022] PUT /identity/v3/projects/d02df540db4b485591ec1a144690a452/users/5a585cdae49745859aeaa9667ef3e37a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:57.578119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.585455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.585455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.585759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:57.601061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 862/1732] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:57.621046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] MFA Rules not processed for user `5a585cdae49745859aeaa9667ef3e37a`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:57.622817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:57.628249 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:57.679280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:57.680925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:57.713192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2188b-cc54-42ae-81af-a71d584554d6 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:57.799193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 871/1733] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:57.810510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:57.812361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:57.911866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:57.911866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.911866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.911866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] PATH_INFO: `/v3/projects/b272cfd1714a4fd198cbb68f62f098f5` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.913519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b272cfd1714a4fd198cbb68f62f098f5)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:57.916580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:57.980841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c3d5-10c9-45d8-9c1d-fb62add96cf9 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:57.993151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:57.993789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:57.994066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:57.994358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:57.998829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:58.151691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b272cfd1714a4fd198cbb68f62f098f5', 'request_id': 'req-2abeed02-0746-4d76-b486-cb5d8b24f558'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:58.163319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:58.164925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:58.166987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b272cfd1714a4fd198cbb68f62f098f5', 'request_id': 'req-2abeed02-0746-4d76-b486-cb5d8b24f558'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:58.190609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 872/1734] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:13:58.192172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:58.207654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818d0a5-656a-418d-9690-4baf1eec9c57 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:58.325542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218af4f1-3dd2-4f33-bcc4-534a3c66d9a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:58.326241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218af4f1-3dd2-4f33-bcc4-534a3c66d9a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:58.326521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218af4f1-3dd2-4f33-bcc4-534a3c66d9a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:58.326791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218af4f1-3dd2-4f33-bcc4-534a3c66d9a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:58.332618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-218af4f1-3dd2-4f33-bcc4-534a3c66d9a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:58.364018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:58.365023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b272cfd1714a4fd198cbb68f62f098f5', 'request_id': 'req-2abeed02-0746-4d76-b486-cb5d8b24f558'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:58.398622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] The token cache is being invalidate because project b272cfd1714a4fd198cbb68f62f098f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:13:58.398935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:58.402486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2abeed02-0746-4d76-b486-cb5d8b24f558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:58.417436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 863/1735] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:57 2022] DELETE /identity/v3/projects/b272cfd1714a4fd198cbb68f62f098f5 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:13:58.417780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4265-ba0f-46c8-9700-b25842355d82 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:58.418092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4265-ba0f-46c8-9700-b25842355d82 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:58.418408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f4265-ba0f-46c8-9700-b25842355d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:58.478927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218af4f1-3dd2-4f33-bcc4-534a3c66d9a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:58.480726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218af4f1-3dd2-4f33-bcc4-534a3c66d9a7 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:58.493876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-126f4265-ba0f-46c8-9700-b25842355d82 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:58.494393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 873/1736] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:13:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:13:58.501242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-126f4265-ba0f-46c8-9700-b25842355d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:58.620774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064fb6-7eb8-42b9-86da-48c16a119b30 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:58.621063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064fb6-7eb8-42b9-86da-48c16a119b30 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:58.621672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064fb6-7eb8-42b9-86da-48c16a119b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:58.752088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 864/1737] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:58.760997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623502-50ad-487c-b328-62b812b8301a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:58.761442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623502-50ad-487c-b328-62b812b8301a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:58.767882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623502-50ad-487c-b328-62b812b8301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:58.777223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-af064fb6-7eb8-42b9-86da-48c16a119b30 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:58.779060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-af064fb6-7eb8-42b9-86da-48c16a119b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:58.858651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-28623502-50ad-487c-b328-62b812b8301a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:58.860188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-28623502-50ad-487c-b328-62b812b8301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:58.871025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 865/1738] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:13:58.876061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623502-50ad-487c-b328-62b812b8301a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:58.889288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623502-50ad-487c-b328-62b812b8301a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:58.896918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:58.898070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:58.898360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:58.898639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:58.899313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:13:58.899794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:58.904061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:58.906990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 874/1739] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:13:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:13:58.929704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 866/1740] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:13:58.933431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af064fb6-7eb8-42b9-86da-48c16a119b30 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:58.967941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af064fb6-7eb8-42b9-86da-48c16a119b30 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:58.977431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:58.978234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:58.978813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:58.979404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:58.981353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:58.984527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:58.986905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:59.002413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:59.014953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba719ce-63f2-4fad-bf84-d21c2bdacbaa admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:59.029920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:59.030564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:59.030853 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:59.031135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] PATH_INFO: `/v3/projects/e0e012f8cb9a4667bc78dc7761712f91` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:59.032794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e012f8cb9a4667bc78dc7761712f91)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:59.048086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:59.233075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 875/1741] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:13:58 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:13:59.234816 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:59.275055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e012f8cb9a4667bc78dc7761712f91', 'request_id': 'req-805e953c-b554-40cc-bcca-8cb517c33dc4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:59.284131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e012f8cb9a4667bc78dc7761712f91', 'request_id': 'req-805e953c-b554-40cc-bcca-8cb517c33dc4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:59.323429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e54c7-bba6-431f-b9a5-3233b819c947 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:59.332577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:59.333377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:59.333724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:59.335137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:59.335137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:59.336898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:59.440852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e012f8cb9a4667bc78dc7761712f91', 'request_id': 'req-805e953c-b554-40cc-bcca-8cb517c33dc4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:59.455707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] The token cache is being invalidate because project e0e012f8cb9a4667bc78dc7761712f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:13:59.456054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:59.456718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:59.458519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 867/1742] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:58 2022] DELETE /identity/v3/projects/e0e012f8cb9a4667bc78dc7761712f91 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:13:59.459090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:59.461201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:59.514543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 876/1743] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:13:59 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:13:59.515669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:13:59.518351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:59.557374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07b8e1-3164-4ab5-ba10-135b2fd9852b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:59.585309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:59.586195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:59.586627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:59.591049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] PATH_INFO: `/v3/projects/c864397d3d13404091dd844d2173a16e` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:59.592664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c864397d3d13404091dd844d2173a16e)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:59.598789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:59.626378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e953c-b554-40cc-bcca-8cb517c33dc4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:13:59.759284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a217d-0790-4a34-9e91-0604098b16b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:13:59.762114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a217d-0790-4a34-9e91-0604098b16b2 service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:59.762917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a217d-0790-4a34-9e91-0604098b16b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:59.763896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a217d-0790-4a34-9e91-0604098b16b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:59.770832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f48a217d-0790-4a34-9e91-0604098b16b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:13:59.835974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c864397d3d13404091dd844d2173a16e', 'request_id': 'req-0c5b346f-e78f-484f-bd42-191ae066df0c'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:59.862364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a217d-0790-4a34-9e91-0604098b16b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:13:59.865285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a217d-0790-4a34-9e91-0604098b16b2 service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:13:59.867653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c864397d3d13404091dd844d2173a16e', 'request_id': 'req-0c5b346f-e78f-484f-bd42-191ae066df0c'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:13:59.892186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 868/1744] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:13:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:13:59.893948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ee6b-94cc-40fd-8aec-cb2b0c2c7d38 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:13:59.894245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ee6b-94cc-40fd-8aec-cb2b0c2c7d38 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:13:59.895363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ee6b-94cc-40fd-8aec-cb2b0c2c7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:13:59.979752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-afa5ee6b-94cc-40fd-8aec-cb2b0c2c7d38 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:13:59.981048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-afa5ee6b-94cc-40fd-8aec-cb2b0c2c7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.018700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c864397d3d13404091dd844d2173a16e', 'request_id': 'req-0c5b346f-e78f-484f-bd42-191ae066df0c'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:00.056482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] The token cache is being invalidate because project c864397d3d13404091dd844d2173a16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:00.056482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:00.056482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:00.061806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 877/1745] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:13:59 2022] DELETE /identity/v3/projects/c864397d3d13404091dd844d2173a16e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:00.062971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:00.070104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.169420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b346f-e78f-484f-bd42-191ae066df0c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:00.178431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7dac4-d3d4-4ac2-bf05-d5e93f045a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:00.182040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7dac4-d3d4-4ac2-bf05-d5e93f045a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.182345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7dac4-d3d4-4ac2-bf05-d5e93f045a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.182801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7dac4-d3d4-4ac2-bf05-d5e93f045a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.183613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7dac4-d3d4-4ac2-bf05-d5e93f045a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:00.189123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7dac4-d3d4-4ac2-bf05-d5e93f045a6a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:00.215558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 869/1746] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:00.217426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.217843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.218246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.221553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 878/1747] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:00.229088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d1a4-afa1-4bb6-846d-7c3fe2c6e505 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.229388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d1a4-afa1-4bb6-846d-7c3fe2c6e505 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.229833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384d1a4-afa1-4bb6-846d-7c3fe2c6e505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.246197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] MFA Rules not processed for user `3819d2b7da64494f9ed77f670b7c23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:00.248239 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.309018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1384d1a4-afa1-4bb6-846d-7c3fe2c6e505 None None] MFA Rules not processed for user `e8776ca5fe264cee904f8fab1a16a5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:00.311710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1384d1a4-afa1-4bb6-846d-7c3fe2c6e505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.420962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 870/1748] 10.222.0.55 () {58 vars in 1015 bytes} [Thu Aug 25 05:14:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:00.423852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:00.427948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.475895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 879/1749] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:00.475895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c127-7404-406b-84d3-21b4711c9d78 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.475895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c127-7404-406b-84d3-21b4711c9d78 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.475895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618c127-7404-406b-84d3-21b4711c9d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.494363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e7b51-27a1-49e5-a217-802992f70e04 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:00.510392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:00.511747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.512504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.512881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] PATH_INFO: `/v3/users/c14187ee346e42579ca4af2d8d073089` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.515760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14187ee346e42579ca4af2d8d073089)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:00.518451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:00.565848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5618c127-7404-406b-84d3-21b4711c9d78 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:00.571005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5618c127-7404-406b-84d3-21b4711c9d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.607402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 880/1750] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:00.612220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c127-7404-406b-84d3-21b4711c9d78 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:00.631244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618c127-7404-406b-84d3-21b4711c9d78 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:00.638421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:00.639504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.640228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.640718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.641928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:00.645873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:00.668320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 881/1751] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:00.668320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:00.676348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.699138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d980e-4f29-431a-896b-1772b62f1cc0 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:00.748248 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:00.750142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.751066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.753413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.766002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:00.768204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:00.801281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 882/1752] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:00.802660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:00.837326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c153da-5ae7-4bbb-911d-28b30240cab9 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:00.868365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:00.868668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14187ee346e42579ca4af2d8d073089'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:00.869906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14187ee346e42579ca4af2d8d073089'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:00.870832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:00.871409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14187ee346e42579ca4af2d8d073089'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:00.873706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:00.875099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:00.876050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:00.878516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:00.888016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:00.935820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 883/1753] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:00.936435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:00.940819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:00.978336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0ba5e-795a-4ac6-aa09-c2497c89edef admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:00.998988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:00.999950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:01.000392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:01.001182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] PATH_INFO: `/v3/projects/a8a2fbfec9804726b15b40d0c882849c/users/e880aa8b03ca4c0297b95b5a57caeade/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:01.014252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14187ee346e42579ca4af2d8d073089'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:01.026655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14187ee346e42579ca4af2d8d073089'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:01.057392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a2fbfec9804726b15b40d0c882849c, user_id=e880aa8b03ca4c0297b95b5a57caeade, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:01.064414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:01.117197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:01.133351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 871/1754] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:00 2022] DELETE /identity/v3/users/c14187ee346e42579ca4af2d8d073089 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:01.139715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:01.144162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:01.156757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 884/1755] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:00 2022] PUT /identity/v3/projects/a8a2fbfec9804726b15b40d0c882849c/users/e880aa8b03ca4c0297b95b5a57caeade/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:01.168147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:01.172743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:01.395862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb460ab-6b25-4577-b334-85d9ad455c3e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:01.395862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c737928-a314-431b-bd07-6e5def4cf241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:01.395862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c737928-a314-431b-bd07-6e5def4cf241 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:01.395862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c737928-a314-431b-bd07-6e5def4cf241 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:01.396212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c737928-a314-431b-bd07-6e5def4cf241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:01.396212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2c737928-a314-431b-bd07-6e5def4cf241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:01.396352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe2d32-cc67-4f74-b44c-19dfc73fae18 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:01.492102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c737928-a314-431b-bd07-6e5def4cf241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:01.494475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c737928-a314-431b-bd07-6e5def4cf241 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:01.630433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 885/1756] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:01.630433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f86d0-0634-4b37-b61e-f9a05efb4d09 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:01.630433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f86d0-0634-4b37-b61e-f9a05efb4d09 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:01.630433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f86d0-0634-4b37-b61e-f9a05efb4d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:01.631761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130c099-5639-4e25-a9df-5404cb13dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:01.631761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130c099-5639-4e25-a9df-5404cb13dbff admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:01.631761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130c099-5639-4e25-a9df-5404cb13dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:01.631761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130c099-5639-4e25-a9df-5404cb13dbff admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:01.632367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130c099-5639-4e25-a9df-5404cb13dbff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:01.632367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130c099-5639-4e25-a9df-5404cb13dbff admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:01.632498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-256f86d0-0634-4b37-b61e-f9a05efb4d09 None None] MFA Rules not processed for user `e880aa8b03ca4c0297b95b5a57caeade`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:01.632498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-256f86d0-0634-4b37-b61e-f9a05efb4d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:01.836523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 886/1757] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:01.837991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30a816-0f71-426e-adc0-4924bf0e0c47 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:01.838287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30a816-0f71-426e-adc0-4924bf0e0c47 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:01.838564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30a816-0f71-426e-adc0-4924bf0e0c47 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:01.840282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 887/1758] 10.222.0.45 () {54 vars in 912 bytes} [Thu Aug 25 05:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:14:01.846362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30a816-0f71-426e-adc0-4924bf0e0c47 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:01.874807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30a816-0f71-426e-adc0-4924bf0e0c47 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:01.887346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:01.888278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:01.888534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:01.890038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:01.897979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:01.897979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:01.978158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 872/1759] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:01 2022] POST /identity/v3/projects => generated 381 bytes in 837 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:01.978158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b30719-93d1-485a-8a54-7ec3d6934d15 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:01.978158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b30719-93d1-485a-8a54-7ec3d6934d15 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:01.978158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b30719-93d1-485a-8a54-7ec3d6934d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.068476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-59b30719-93d1-485a-8a54-7ec3d6934d15 None None] MFA Rules not processed for user `3819d2b7da64494f9ed77f670b7c23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:02.071702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 888/1760] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:01 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:02.072781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.076625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-59b30719-93d1-485a-8a54-7ec3d6934d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:02.295056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 873/1761] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:14:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:02.297625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b30719-93d1-485a-8a54-7ec3d6934d15 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.335966 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb6f7-c4f8-4e7d-a4ee-69143f1cf83b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.341793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.342427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.342939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.343236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.344153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.346240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.440401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b30719-93d1-485a-8a54-7ec3d6934d15 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.448665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.449418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.449706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.450060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.450930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.454793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.478382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 889/1762] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:02 2022] POST /identity/v3/users => generated 291 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:02.481407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.484414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:02.502256 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4acf5-58a3-4c27-a261-a80907d1a229 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.511939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.513237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.513557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.513843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.528672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.529598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.543017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 890/1763] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:02.544358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.557602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac0ef1-4ea5-427f-af8e-b0aeb1c01dec service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.563203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.563845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.564163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.564437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.565477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.568533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.589195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 891/1764] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:02.590625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.603782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b905642-85f6-46f9-8c73-dfd1f95ea532 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.609370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.610167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.610410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.610686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.612113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.615807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.633807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 892/1765] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:02.635090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.647264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b8812-07c2-4278-b4ea-5fe28bd839b9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.667567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.670032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.670346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.670618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] PATH_INFO: `/v3/projects/7ee7c6571db6475d8ca0ade97672479c/users/177dc7e69bbb4545ab551bc4f6d21ac0/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.681226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 874/1766] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:02 2022] POST /identity/v3/users => generated 297 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:02.685481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.710649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:02.715045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087693f-09c0-4a12-94c9-7287d812ac3d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.723950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.724586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.724864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.725155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.725791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.727446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.729725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee7c6571db6475d8ca0ade97672479c, user_id=177dc7e69bbb4545ab551bc4f6d21ac0, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.733415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.767984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 875/1767] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:02.767984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.772552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:02.795109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f7bcf-844f-4778-98cf-08a5cb871768 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:02.809056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:02.809734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:02.810634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:02.811193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] PATH_INFO: `/v3/projects/2304b56d6bf34a17ad42769dab485ac3` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:02.820102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2304b56d6bf34a17ad42769dab485ac3)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:02.823021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:02.833349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 893/1768] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:02 2022] PUT /identity/v3/projects/7ee7c6571db6475d8ca0ade97672479c/users/177dc7e69bbb4545ab551bc4f6d21ac0/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:02.834266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:02.996560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830af17e-a75b-402e-95de-08b4f101a947 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:03.021637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2304b56d6bf34a17ad42769dab485ac3', 'request_id': 'req-72a7bbb2-427d-4343-8fd2-f8ab5b781301'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:03.036051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2304b56d6bf34a17ad42769dab485ac3', 'request_id': 'req-72a7bbb2-427d-4343-8fd2-f8ab5b781301'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:03.166610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc81e20-19e5-46b2-b269-34cc84479127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:03.167576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81e20-19e5-46b2-b269-34cc84479127 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.167953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81e20-19e5-46b2-b269-34cc84479127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.168346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc81e20-19e5-46b2-b269-34cc84479127 admin admin] PATH_INFO: `/v3/projects/95f3b88708124bf396bc2c205d49f955/users/79e7f76478e64c64be1bf20f528db1d4/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.190312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2304b56d6bf34a17ad42769dab485ac3', 'request_id': 'req-72a7bbb2-427d-4343-8fd2-f8ab5b781301'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:03.190658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc81e20-19e5-46b2-b269-34cc84479127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f3b88708124bf396bc2c205d49f955, user_id=79e7f76478e64c64be1bf20f528db1d4, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:03.195779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc81e20-19e5-46b2-b269-34cc84479127 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:03.228573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] The token cache is being invalidate because project 2304b56d6bf34a17ad42769dab485ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:03.228573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:03.228573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-72a7bbb2-427d-4343-8fd2-f8ab5b781301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:03.228573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 876/1769] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:02 2022] DELETE /identity/v3/projects/2304b56d6bf34a17ad42769dab485ac3 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:03.232470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f61ff-edb0-454b-9c46-a15ef4341b46 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.236100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f61ff-edb0-454b-9c46-a15ef4341b46 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.236424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f61ff-edb0-454b-9c46-a15ef4341b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.302064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e92f61ff-edb0-454b-9c46-a15ef4341b46 None None] MFA Rules not processed for user `177dc7e69bbb4545ab551bc4f6d21ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:03.303345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e92f61ff-edb0-454b-9c46-a15ef4341b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:03.305986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 894/1770] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:02 2022] PUT /identity/v3/projects/95f3b88708124bf396bc2c205d49f955/users/79e7f76478e64c64be1bf20f528db1d4/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:03.310710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.310710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.310710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.371416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:03.374756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:03.554903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 895/1771] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:03.555600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:03.557292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 877/1772] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:03.559971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:03.575044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c96622-53ae-4de2-88bb-575420ddc411 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.575044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c96622-53ae-4de2-88bb-575420ddc411 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.581821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c96622-53ae-4de2-88bb-575420ddc411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.612105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67a9c2-760f-4fc2-a68c-eebe1d12dd83 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:03.639818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:03.640479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.640758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.641033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.641795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:03.647156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:03.666412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 896/1773] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:03.668853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:03.671123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:03.710009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-72c96622-53ae-4de2-88bb-575420ddc411 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:03.713984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-72c96622-53ae-4de2-88bb-575420ddc411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:03.757145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 878/1774] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:03.758738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c96622-53ae-4de2-88bb-575420ddc411 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:03.783430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c96622-53ae-4de2-88bb-575420ddc411 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:03.795735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:03.799248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.799542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.799822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] PATH_INFO: `/v3/projects/95f3b88708124bf396bc2c205d49f955/users/79e7f76478e64c64be1bf20f528db1d4/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.809455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f3b88708124bf396bc2c205d49f955, user_id=79e7f76478e64c64be1bf20f528db1d4, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:03.818067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e05c4-c9d1-4b6f-bf20-2a1b47bdaea1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:03.818760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:03.828491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e3a59-73b1-4298-9c1e-2bcdc58c2928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:03.830658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e3a59-73b1-4298-9c1e-2bcdc58c2928 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.831452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e3a59-73b1-4298-9c1e-2bcdc58c2928 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.831603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e3a59-73b1-4298-9c1e-2bcdc58c2928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.888921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 879/1775] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:03 2022] PUT /identity/v3/projects/95f3b88708124bf396bc2c205d49f955/users/79e7f76478e64c64be1bf20f528db1d4/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:03.892101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:03.906162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e3a59-73b1-4298-9c1e-2bcdc58c2928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:03.915412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e3a59-73b1-4298-9c1e-2bcdc58c2928 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:03.963664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 897/1776] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:03.965201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657b036-0b35-4437-929f-fb8e5c4f8780 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.970606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657b036-0b35-4437-929f-fb8e5c4f8780 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.974678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657b036-0b35-4437-929f-fb8e5c4f8780 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:03.987673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 898/1777] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:14:03 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:14:03.999135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6682b-9d96-4b3f-abdf-03ce25d808fd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:03.999135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6682b-9d96-4b3f-abdf-03ce25d808fd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:03.999135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6682b-9d96-4b3f-abdf-03ce25d808fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.037262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7505407-0f76-4010-b1b3-2227b105c690 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:04.054491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:04.055390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:04.055833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:04.056841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.057917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:04.058826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-38a6682b-9d96-4b3f-abdf-03ce25d808fd None None] MFA Rules not processed for user `79e7f76478e64c64be1bf20f528db1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:04.059306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:04.061313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:04.063746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-38a6682b-9d96-4b3f-abdf-03ce25d808fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:04.117537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 880/1778] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:04.122744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:04.144998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629465f-66b9-480b-9f3b-882a03d8ebfc admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:04.173233 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:04.173871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:04.174146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:04.174418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.175058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:04.177788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:04.270681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 899/1779] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:04.276062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:04.276062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:04.276062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.321288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:04.322673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:04.407264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 900/1780] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:14:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:04.453693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:04.463875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:04.477724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:04.477724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 881/1781] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:04 2022] POST /identity/v3/projects => generated 363 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:04.481075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:04.531529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604a9d4-9799-4861-bd59-b09377a42d39 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:04.588167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b05852-9c2d-4596-ab67-24ccdb2e2404 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:04.595255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:04.596783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:04.597222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:04.598257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.600314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:04.602905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:04.662995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:04.663974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:04.664338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:04.664629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.686116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:04.686490 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:04.717962 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 901/1782] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:04.719440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:04.722154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:04.835023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106b6b-934a-403c-8c10-19b84847e1e6 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:04.840835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:04.841860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:04.842491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:04.842815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.898823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 882/1783] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:04 2022] POST /identity/v3/users => generated 282 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:04.905610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:04.926621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef269a-97c0-401a-b508-80680e6605db admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:04.945909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:04.948130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:04.949292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:04.949795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:04.951963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:04.955007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:04.963898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:04.963898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:04.979347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 902/1784] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:04.983115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 883/1785] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:04.988626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:05.006960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5e49c-8f20-4b70-a7f3-db0535caf39f service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:05.012779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209cd2b-44fa-44be-8f54-211af22cf852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:05.014059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209cd2b-44fa-44be-8f54-211af22cf852 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:05.014059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209cd2b-44fa-44be-8f54-211af22cf852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:05.014059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209cd2b-44fa-44be-8f54-211af22cf852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:05.014910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209cd2b-44fa-44be-8f54-211af22cf852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:05.016731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209cd2b-44fa-44be-8f54-211af22cf852 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:05.033348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 903/1786] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:05.034576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:05.048738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9721442-6da5-4d67-af75-e26ba418cc25 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:05.054849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:05.056252 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:05.056808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:05.063426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] PATH_INFO: `/v3/projects/5afb92fbb12348ec8ce32074e25cf814/users/0f7a8ddec4a44c02a3da2744f5e56c7c/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:05.110239 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afb92fbb12348ec8ce32074e25cf814, user_id=0f7a8ddec4a44c02a3da2744f5e56c7c, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:05.117690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:05.340617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 884/1787] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:05 2022] PUT /identity/v3/projects/5afb92fbb12348ec8ce32074e25cf814/users/0f7a8ddec4a44c02a3da2744f5e56c7c/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:05.352678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779335-c0b7-43e7-95e9-a2e6cce20876 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:05.353521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779335-c0b7-43e7-95e9-a2e6cce20876 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:05.353995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779335-c0b7-43e7-95e9-a2e6cce20876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:05.429845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-37779335-c0b7-43e7-95e9-a2e6cce20876 None None] MFA Rules not processed for user `0f7a8ddec4a44c02a3da2744f5e56c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:05.433358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-37779335-c0b7-43e7-95e9-a2e6cce20876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:05.636718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:05.637495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 904/1788] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:05.768736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a278e6-a12f-4198-8b2b-e5ef463d407d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:05.785906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:05.785906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:05.785906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:05.785906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:05.786267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:05.792934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:05.849011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:06.025730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 885/1789] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:05 2022] POST /identity/v3/projects => generated 365 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:06.030831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779335-c0b7-43e7-95e9-a2e6cce20876 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:06.042930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779335-c0b7-43e7-95e9-a2e6cce20876 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:06.165336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:06.166424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:06.166993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:06.167529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:06.168717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:06.172860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:06.297460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 905/1790] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:06 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:06.301535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:06.318990 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c510e-7485-4f8c-ba94-0b9d8a0dce35 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:06.327387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:06.328308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:06.330634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:06.331097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:06.332443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:06.335127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:06.353313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 886/1791] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:06.358270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:06.374987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6ba2f-66c3-4af9-9528-256f9f7ce243 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:06.383099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:06.384268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:06.384687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:06.385065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] PATH_INFO: `/v3/projects/21061c4d3fa44e33875ec8693b167c1d/users/70cd322cb36a4619b75f9d002c7db56a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:06.408866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21061c4d3fa44e33875ec8693b167c1d, user_id=70cd322cb36a4619b75f9d002c7db56a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:06.413315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:06.531929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 906/1792] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:06 2022] PUT /identity/v3/projects/21061c4d3fa44e33875ec8693b167c1d/users/70cd322cb36a4619b75f9d002c7db56a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:06.536799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:06.551758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcb3ce-9e3e-47ba-86c8-2226b86a9438 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:06.792663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207ef9a-0dd8-43ed-86b0-663bd074f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:06.793513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207ef9a-0dd8-43ed-86b0-663bd074f653 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:06.793889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207ef9a-0dd8-43ed-86b0-663bd074f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:06.794281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207ef9a-0dd8-43ed-86b0-663bd074f653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:06.797644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207ef9a-0dd8-43ed-86b0-663bd074f653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:06.811139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207ef9a-0dd8-43ed-86b0-663bd074f653 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:06.850781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:06.851719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 887/1793] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:06.868711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc979-b63d-419f-a6d5-50630e5f3909 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:06.888354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:06.892330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:06.892330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:06.892330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] PATH_INFO: `/v3/projects/21061c4d3fa44e33875ec8693b167c1d/users/70cd322cb36a4619b75f9d002c7db56a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:06.892330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21061c4d3fa44e33875ec8693b167c1d, user_id=70cd322cb36a4619b75f9d002c7db56a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:06.900924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:06.926723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 907/1794] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:06 2022] PUT /identity/v3/projects/21061c4d3fa44e33875ec8693b167c1d/users/70cd322cb36a4619b75f9d002c7db56a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:06.935122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aba61-dccc-41e9-a2e6-0ad254f7da8c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:06.935628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aba61-dccc-41e9-a2e6-0ad254f7da8c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:06.936020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aba61-dccc-41e9-a2e6-0ad254f7da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:07.018380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a25aba61-dccc-41e9-a2e6-0ad254f7da8c None None] MFA Rules not processed for user `70cd322cb36a4619b75f9d002c7db56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:07.021086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a25aba61-dccc-41e9-a2e6-0ad254f7da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:07.189606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:07.251954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 888/1795] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:07.273232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aba61-dccc-41e9-a2e6-0ad254f7da8c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:07.362093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01301d98-70ed-4e40-88c3-9df752634f1b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:07.377642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e7f76478e64c64be1bf20f528db1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95f3b88708124bf396bc2c205d49f955', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:07.379766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:07.380323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:07.381689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:07.383081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:07.383514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:07.396190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:07.405632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 908/1796] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:14:07.406894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:07.419760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96ffd8-b26a-4d14-abf7-253d1acd2411 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:07.426101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e7f76478e64c64be1bf20f528db1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95f3b88708124bf396bc2c205d49f955', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:07.427531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:07.428003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:07.428411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:07.429566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:07.431826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:07.432962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25aba61-dccc-41e9-a2e6-0ad254f7da8c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:07.442973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:07.443870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:07.444300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:07.449639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:07.458906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:07.460628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:07.481310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 889/1797] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:07.559667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:08.314689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 909/1798] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:07 2022] POST /identity/v3/projects => generated 355 bytes in 824 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:08.324646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:08.357080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fafcea-6b72-4f79-a1d0-0b4da1851550 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:08.400708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:08.407320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:08.474832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e7f76478e64c64be1bf20f528db1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95f3b88708124bf396bc2c205d49f955', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:08.475554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:08.475924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:08.477065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:08.481317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:08.481722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:08.485713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:08.530859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 890/1799] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:08.582938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb756f3-ad25-424b-a9d8-edeb36bfd10c tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:08.590026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:08.590828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:08.591098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:08.591373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] PATH_INFO: `/v3/users/e5520a6ebb54401581f1e0c6f68249f3` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:08.592569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5520a6ebb54401581f1e0c6f68249f3)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:08.595047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:08.846489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5520a6ebb54401581f1e0c6f68249f3'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:08.865284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5520a6ebb54401581f1e0c6f68249f3'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:08.866417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5520a6ebb54401581f1e0c6f68249f3'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:08.975609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:09.002798 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fa090-9bee-40c0-8826-7705f4e619b0 tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:09.021796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5520a6ebb54401581f1e0c6f68249f3'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:09.022721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e7f76478e64c64be1bf20f528db1d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95f3b88708124bf396bc2c205d49f955', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:09.023440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:09.023733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:09.025336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] PATH_INFO: `/v3/projects/8e002c6812024d4aa407631cc2eb5ccf` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:09.029200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8e002c6812024d4aa407631cc2eb5ccf)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:09.029200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:09.030776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-068806a9-b2ce-4f62-b9bf-b02559e0a1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5520a6ebb54401581f1e0c6f68249f3'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:09.049081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 910/1800] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:08 2022] DELETE /identity/v3/users/e5520a6ebb54401581f1e0c6f68249f3 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:09.056338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:09.066175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:09.066175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:09.122406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:09.123895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:09.267614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 911/1801] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:09.276984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:09.279205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:09.285284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e002c6812024d4aa407631cc2eb5ccf', 'request_id': 'req-b3191573-e671-404d-8a9a-98dd5fa4400a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:09.300158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e002c6812024d4aa407631cc2eb5ccf', 'request_id': 'req-b3191573-e671-404d-8a9a-98dd5fa4400a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:09.396566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd9bc2-4d83-44cd-8757-c399183e7cc4 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:09.459092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:09.460117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:09.460567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:09.461001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:09.498372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:09.552720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:09.554611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:09.567115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 912/1802] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:09.687367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e002c6812024d4aa407631cc2eb5ccf', 'request_id': 'req-b3191573-e671-404d-8a9a-98dd5fa4400a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:09.721967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] The token cache is being invalidate because project 8e002c6812024d4aa407631cc2eb5ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:09.724415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:09.724415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:09.725773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 891/1803] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:08 2022] DELETE /identity/v3/projects/8e002c6812024d4aa407631cc2eb5ccf => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:10.755521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:10.757323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:10.781947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945ba34-ee79-46c1-8ad6-080f35d008a8 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:10.796371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:10.798633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:10.801401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:10.801811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] PATH_INFO: `/v3/projects/94e3e8506ca64e0c9e679556365dc78a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:10.821433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e3e8506ca64e0c9e679556365dc78a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:10.821433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:11.049031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e3e8506ca64e0c9e679556365dc78a', 'request_id': 'req-26049f33-2874-44f0-b443-f25d93c4792a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.074049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e3e8506ca64e0c9e679556365dc78a', 'request_id': 'req-26049f33-2874-44f0-b443-f25d93c4792a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.228469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:11.230914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:11.254930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191573-e671-404d-8a9a-98dd5fa4400a tempest-VolumeQuotaClassesTest-1422948093 tempest-VolumeQuotaClassesTest-1422948093-project-admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:11.290057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e3e8506ca64e0c9e679556365dc78a', 'request_id': 'req-26049f33-2874-44f0-b443-f25d93c4792a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.314206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] The token cache is being invalidate because project 94e3e8506ca64e0c9e679556365dc78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:11.314508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.315188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.320405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 913/1804] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:10 2022] DELETE /identity/v3/projects/94e3e8506ca64e0c9e679556365dc78a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:11.321646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:11.325001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:11.399613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:11.400505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:11.401443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:11.401443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] PATH_INFO: `/v3/users/e880aa8b03ca4c0297b95b5a57caeade` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:11.402784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e880aa8b03ca4c0297b95b5a57caeade)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:11.405274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:11.484443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26049f33-2874-44f0-b443-f25d93c4792a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:11.498193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:11.498537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:11.498610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:11.499216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] PATH_INFO: `/v3/users/5a585cdae49745859aeaa9667ef3e37a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:11.501585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a585cdae49745859aeaa9667ef3e37a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:11.504637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:11.755185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e880aa8b03ca4c0297b95b5a57caeade'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.757112 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e880aa8b03ca4c0297b95b5a57caeade'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.758129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e880aa8b03ca4c0297b95b5a57caeade'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.792135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a585cdae49745859aeaa9667ef3e37a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.805179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a585cdae49745859aeaa9667ef3e37a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.805914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a585cdae49745859aeaa9667ef3e37a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.848525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e880aa8b03ca4c0297b95b5a57caeade'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.857066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e880aa8b03ca4c0297b95b5a57caeade'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.879941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 892/1805] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:11 2022] DELETE /identity/v3/users/e880aa8b03ca4c0297b95b5a57caeade => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:11.881218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:11.884792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:11.939014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a585cdae49745859aeaa9667ef3e37a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.947009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-813ebb22-2282-4f41-8956-6995c949bb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a585cdae49745859aeaa9667ef3e37a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:11.952270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035dcf-60ae-4398-ac01-fe596ce13ca2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:11.953195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 914/1806] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:11 2022] DELETE /identity/v3/users/5a585cdae49745859aeaa9667ef3e37a => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:11.954488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:11.954775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:11.955122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:11.974800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:11.976062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:12.020224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:12.030007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:12.030007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:12.030007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] PATH_INFO: `/v3/users/0f7a8ddec4a44c02a3da2744f5e56c7c` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:12.030007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7a8ddec4a44c02a3da2744f5e56c7c)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:12.030007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:12.098489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 915/1807] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:12.111349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:12.113529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:12.179444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580c89b-1be5-43e9-8651-29b9cc3c3525 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:12.183450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69537875-4025-4260-ae84-a41af806d1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:12.184090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537875-4025-4260-ae84-a41af806d1ed service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:12.184369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537875-4025-4260-ae84-a41af806d1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:12.184638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69537875-4025-4260-ae84-a41af806d1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:12.196019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69537875-4025-4260-ae84-a41af806d1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:12.198241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69537875-4025-4260-ae84-a41af806d1ed service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:12.213654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 916/1808] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:12.325344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7a8ddec4a44c02a3da2744f5e56c7c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:12.326034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7a8ddec4a44c02a3da2744f5e56c7c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:12.326650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7a8ddec4a44c02a3da2744f5e56c7c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:12.397077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7a8ddec4a44c02a3da2744f5e56c7c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:12.418664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7a8ddec4a44c02a3da2744f5e56c7c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:12.458720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:12.485615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 893/1809] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:11 2022] DELETE /identity/v3/users/0f7a8ddec4a44c02a3da2744f5e56c7c => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:12.491315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:12.491665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:12.491983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:12.552569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:12.558291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:12.638659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 917/1810] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:12.684636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:12.687104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:12.838292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2e8d1-4d10-41dd-9e5a-54780c7bbb2a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:12.842290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:12.842907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:12.843184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:12.843454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:12.857090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:12.858934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:12.871082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 894/1811] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:12.882871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:13.024787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:13.025816 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:13.041581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4d514-a6a7-48a5-90ec-3da00bcc2a91 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:13.047106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:13.047794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.048056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.049268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] PATH_INFO: `/v3/projects/d02df540db4b485591ec1a144690a452` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.049550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02df540db4b485591ec1a144690a452)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:13.052325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:13.069660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:13.071774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:13.093790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e616d7-c5c6-4f8e-a8da-46c20b08062c service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:13.113590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:13.113590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.113590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.113590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] PATH_INFO: `/v3/projects/a8a2fbfec9804726b15b40d0c882849c` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.114796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a2fbfec9804726b15b40d0c882849c)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:13.128666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:13.240096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02df540db4b485591ec1a144690a452', 'request_id': 'req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.247403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02df540db4b485591ec1a144690a452', 'request_id': 'req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.324140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02df540db4b485591ec1a144690a452', 'request_id': 'req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.327339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a2fbfec9804726b15b40d0c882849c', 'request_id': 'req-209e677f-6851-4021-a206-83bfb350e8c6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.340846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a2fbfec9804726b15b40d0c882849c', 'request_id': 'req-209e677f-6851-4021-a206-83bfb350e8c6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.343012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] The token cache is being invalidate because project d02df540db4b485591ec1a144690a452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:13.344528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.346387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-39f7445e-3e72-4ced-8bd4-eefe890d0e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.349038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 918/1812] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:13 2022] DELETE /identity/v3/projects/d02df540db4b485591ec1a144690a452 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:13.356219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79021b3-063e-4a65-8e55-f79594713400 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.356646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79021b3-063e-4a65-8e55-f79594713400 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.357836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79021b3-063e-4a65-8e55-f79594713400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.391553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-c79021b3-063e-4a65-8e55-f79594713400 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:13.401267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c79021b3-063e-4a65-8e55-f79594713400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:13.469476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a2fbfec9804726b15b40d0c882849c', 'request_id': 'req-209e677f-6851-4021-a206-83bfb350e8c6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.481654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 919/1813] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:13.483617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942a6f-3839-461c-b74c-b128beba9492 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.483932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942a6f-3839-461c-b74c-b128beba9492 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.484224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942a6f-3839-461c-b74c-b128beba9492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.493809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] The token cache is being invalidate because project a8a2fbfec9804726b15b40d0c882849c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:13.494446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.495274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.496829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 895/1814] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:13 2022] DELETE /identity/v3/projects/a8a2fbfec9804726b15b40d0c882849c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:13.500903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:13.503603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:13.510625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-fb942a6f-3839-461c-b74c-b128beba9492 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:13.511944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fb942a6f-3839-461c-b74c-b128beba9492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:13.517487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e677f-6851-4021-a206-83bfb350e8c6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:13.522914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:13.523502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 920/1815] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:13.523597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.523843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.524150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] PATH_INFO: `/v3/users/79e7f76478e64c64be1bf20f528db1d4` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.525296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e7f76478e64c64be1bf20f528db1d4)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:13.527240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:13.527861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942a6f-3839-461c-b74c-b128beba9492 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:13.541704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942a6f-3839-461c-b74c-b128beba9492 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:13.547470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:13.548136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.548407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.548690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.549353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:13.549662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:13.551479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:13.567153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 921/1816] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:14:13.568184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:13.580557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea6b6a-90f6-4750-a286-8393009ad80d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:13.584355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481657de-f253-43ee-87fc-67876194df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:13.584960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481657de-f253-43ee-87fc-67876194df92 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.585241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481657de-f253-43ee-87fc-67876194df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.585516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481657de-f253-43ee-87fc-67876194df92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.586172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481657de-f253-43ee-87fc-67876194df92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:13.588128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481657de-f253-43ee-87fc-67876194df92 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:13.775692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 922/1817] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:13 2022] POST /identity/v3/projects => generated 399 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:13.775692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ec9e-e989-4511-b0f0-dff61f8833ca None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.775692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ec9e-e989-4511-b0f0-dff61f8833ca None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.775692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ec9e-e989-4511-b0f0-dff61f8833ca None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.775692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 923/1818] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:14:13.775692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ec9e-e989-4511-b0f0-dff61f8833ca None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:13.776570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bf95ec9e-e989-4511-b0f0-dff61f8833ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:13.823609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e7f76478e64c64be1bf20f528db1d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.824415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e7f76478e64c64be1bf20f528db1d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.825117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e7f76478e64c64be1bf20f528db1d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.848781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ec9e-e989-4511-b0f0-dff61f8833ca None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:13.853592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:13.860431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:13.860431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:13.860431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] PATH_INFO: `/v3/projects/5afb92fbb12348ec8ce32074e25cf814` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:13.860431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afb92fbb12348ec8ce32074e25cf814)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:13.860431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:13.916260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e7f76478e64c64be1bf20f528db1d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.934946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e7f76478e64c64be1bf20f528db1d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:13.957937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 896/1819] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:13 2022] DELETE /identity/v3/users/79e7f76478e64c64be1bf20f528db1d4 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:13.958839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:13.960401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:13.992696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afb92fbb12348ec8ce32074e25cf814', 'request_id': 'req-3f4e0315-9322-4622-8268-e9a608699305'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.002923 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afb92fbb12348ec8ce32074e25cf814', 'request_id': 'req-3f4e0315-9322-4622-8268-e9a608699305'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.054049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcf07a-2a16-4a48-9ab4-232b0d6a4cc9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.125098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.125675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.125964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.126241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.126885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.133907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:14.144705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afb92fbb12348ec8ce32074e25cf814', 'request_id': 'req-3f4e0315-9322-4622-8268-e9a608699305'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.178743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] The token cache is being invalidate because project 5afb92fbb12348ec8ce32074e25cf814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:14.179038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.179718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f4e0315-9322-4622-8268-e9a608699305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.181397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 924/1820] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:13 2022] DELETE /identity/v3/projects/5afb92fbb12348ec8ce32074e25cf814 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:14.183620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.183942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.184208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.206122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:14.207752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:14.275977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 897/1821] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:13 2022] POST /identity/v3/users => generated 300 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:14.276920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:14.278594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:14.290079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 925/1822] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:14:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:14.291130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4f491-2a25-4947-930a-fb1e8a43e1fb admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.291698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:14.293631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:14.312677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8223f8-c7c4-43f8-8754-40243132b773 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.313312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.314043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.314327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.314655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] PATH_INFO: `/v3/users/70cd322cb36a4619b75f9d002c7db56a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.321454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cd322cb36a4619b75f9d002c7db56a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.323978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:14.324943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.325069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.325261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.325546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.326396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.331103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:14.341463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 926/1823] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:14.342954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:14.345295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:14.366533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffef58-7b9f-447f-afe7-1c93319422da admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.372781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.373397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.373857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.374458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.396761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.398804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:14.412581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 927/1824] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:14.425540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:14.462017 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814a8d3-b0ee-4181-a4cc-32d779395c0d service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.467164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.468279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.468616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.468965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.469697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.471590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:14.488910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 928/1825] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:14.492472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:14.505699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88f40e-7e40-4618-b7a9-76c5603b9daa admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.513164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.513164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.513164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.513164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] PATH_INFO: `/v3/projects/9083fc8a03bc41008e05c18b4c10f269/users/7f6fb8b1935e41b994c13a3ab6073718/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.528231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9083fc8a03bc41008e05c18b4c10f269, user_id=7f6fb8b1935e41b994c13a3ab6073718, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.532272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:14.631785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cd322cb36a4619b75f9d002c7db56a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.632770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cd322cb36a4619b75f9d002c7db56a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.634033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cd322cb36a4619b75f9d002c7db56a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.739647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 929/1826] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:14 2022] PUT /identity/v3/projects/9083fc8a03bc41008e05c18b4c10f269/users/7f6fb8b1935e41b994c13a3ab6073718/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:14.741457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:14.744614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:14.762760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cd322cb36a4619b75f9d002c7db56a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.772019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a877b0f8-dace-4f00-ad02-dee0f13d55ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cd322cb36a4619b75f9d002c7db56a'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:14.801820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 898/1827] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:14 2022] DELETE /identity/v3/users/70cd322cb36a4619b75f9d002c7db56a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:14.804808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.804808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.804808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.835149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] MFA Rules not processed for user `7f6fb8b1935e41b994c13a3ab6073718`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:14.836447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:14.840750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845cf0e-e57b-4436-aa08-7bf57b12ed71 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.904262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.904925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.905201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.905467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] PATH_INFO: `/v3/projects/95f3b88708124bf396bc2c205d49f955` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.906724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f3b88708124bf396bc2c205d49f955)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.907745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 899/1828] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:14.908831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:14.916706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:14.918174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:14.938010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea346f-ea97-4510-9f89-9ea2adb835b9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:14.942812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:14.943427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:14.944131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:14.944422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:14.945058 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:14.946975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.060923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 900/1829] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:14 2022] POST /identity/v3/projects => generated 401 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:15.065196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.074109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f3b88708124bf396bc2c205d49f955', 'request_id': 'req-5b4bbd85-444e-4821-8e12-c5323698245f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.084655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f3b88708124bf396bc2c205d49f955', 'request_id': 'req-5b4bbd85-444e-4821-8e12-c5323698245f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.141130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cd11d-db86-4f1f-9e4d-b7124e969015 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.152017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.152017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.152017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.152017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.152473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.154512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.208107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f3b88708124bf396bc2c205d49f955', 'request_id': 'req-5b4bbd85-444e-4821-8e12-c5323698245f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.220750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] The token cache is being invalidate because project 95f3b88708124bf396bc2c205d49f955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:15.221043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.221708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-5b4bbd85-444e-4821-8e12-c5323698245f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.225585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 930/1830] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:14 2022] DELETE /identity/v3/projects/95f3b88708124bf396bc2c205d49f955 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:15.230166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec4ae9-d3ad-4d7a-a523-4d491dd071b0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.230454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec4ae9-d3ad-4d7a-a523-4d491dd071b0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.230734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec4ae9-d3ad-4d7a-a523-4d491dd071b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.246325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 901/1831] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:15 2022] POST /identity/v3/users => generated 307 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:15.250506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.252304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:15.262167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5eec4ae9-d3ad-4d7a-a523-4d491dd071b0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:15.264712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5eec4ae9-d3ad-4d7a-a523-4d491dd071b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:15.273994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1281216-4e21-41ce-ac3e-bd2f2fe8d898 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.277938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 931/1832] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:15.282674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.283435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.283765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.286009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485be144-69b0-46ab-892e-d8fdad0843b1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.286351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485be144-69b0-46ab-892e-d8fdad0843b1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.286624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485be144-69b0-46ab-892e-d8fdad0843b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.289636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.291944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.292202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.306076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 902/1833] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:15.313659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.316755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-485be144-69b0-46ab-892e-d8fdad0843b1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:15.317980 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-485be144-69b0-46ab-892e-d8fdad0843b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:15.324989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ee401-7cac-48e7-a484-ab127f0acdd9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.328121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 932/1834] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:15.329970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.330935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.332572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.332718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485be144-69b0-46ab-892e-d8fdad0843b1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.332880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] PATH_INFO: `/v3/projects/72e8bdb541e641b4a8d2bc21576a9e82/users/697fcc0a3e2643358adf6498f8d0a0de/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.345294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485be144-69b0-46ab-892e-d8fdad0843b1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.354176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.355374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.355656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.355765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e8bdb541e641b4a8d2bc21576a9e82, user_id=697fcc0a3e2643358adf6498f8d0a0de, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.355949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.356619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:15.356992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.358417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.359261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.374637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 933/1835] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:15.379346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.399769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259658a-6816-44ad-8395-3fe7daa2c4e7 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.404755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.405308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.405590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.405866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.406501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.408496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.492441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 903/1836] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:15 2022] PUT /identity/v3/projects/72e8bdb541e641b4a8d2bc21576a9e82/users/697fcc0a3e2643358adf6498f8d0a0de/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:15.492441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.492441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:15.562787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29db8b-7012-45a9-8ad1-d79ae8832a21 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.567940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.568573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.568852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.569123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] PATH_INFO: `/v3/projects/21061c4d3fa44e33875ec8693b167c1d` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.570244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=21061c4d3fa44e33875ec8693b167c1d)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.572270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.615192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 934/1837] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:15 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:15.616359 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.685899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6efebb-980b-4269-b76b-d838224f883f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.692267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.692890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.693218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.693477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.694129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.695845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.713320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 935/1838] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:15.717497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.719268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:15.720306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21061c4d3fa44e33875ec8693b167c1d', 'request_id': 'req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.727863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21061c4d3fa44e33875ec8693b167c1d', 'request_id': 'req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.734835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050298f-6f7f-4604-a305-1bdc98c27af0 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.822665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.824150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.824150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.824150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] PATH_INFO: `/v3/users/177dc7e69bbb4545ab551bc4f6d21ac0` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.825252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=177dc7e69bbb4545ab551bc4f6d21ac0)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.827548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:15.848443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21061c4d3fa44e33875ec8693b167c1d', 'request_id': 'req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.861287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] The token cache is being invalidate because project 21061c4d3fa44e33875ec8693b167c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:15.861691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.862426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:15.864588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 904/1839] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:15 2022] DELETE /identity/v3/projects/21061c4d3fa44e33875ec8693b167c1d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:15.865682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:15.867145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:15.877908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:15.882280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d1bef-fa68-43ef-9b6f-f3418e2beffd admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:15.887197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:15.887809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:15.888116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:15.888391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:15.889080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:15.891028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.081709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 905/1840] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:15 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:16.082776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.086387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.090914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177dc7e69bbb4545ab551bc4f6d21ac0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:16.101309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ddcd-0be3-4e80-b340-b8c1a38403c9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.104965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177dc7e69bbb4545ab551bc4f6d21ac0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:16.106198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177dc7e69bbb4545ab551bc4f6d21ac0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:16.106462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db41dde-8e73-45eb-bb39-e93e1eb845c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.107130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41dde-8e73-45eb-bb39-e93e1eb845c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.107412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41dde-8e73-45eb-bb39-e93e1eb845c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.107683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db41dde-8e73-45eb-bb39-e93e1eb845c8 admin admin] PATH_INFO: `/v3/projects/72e8bdb541e641b4a8d2bc21576a9e82/users/697fcc0a3e2643358adf6498f8d0a0de/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.109758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db41dde-8e73-45eb-bb39-e93e1eb845c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e8bdb541e641b4a8d2bc21576a9e82, user_id=697fcc0a3e2643358adf6498f8d0a0de, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.115852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db41dde-8e73-45eb-bb39-e93e1eb845c8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.125411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 906/1841] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:16 2022] PUT /identity/v3/projects/72e8bdb541e641b4a8d2bc21576a9e82/users/697fcc0a3e2643358adf6498f8d0a0de/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:16.126839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8864-e813-4814-8477-3c16db27a634 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.127312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8864-e813-4814-8477-3c16db27a634 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.127669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f8864-e813-4814-8477-3c16db27a634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.150123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e39f8864-e813-4814-8477-3c16db27a634 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:16.151470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e39f8864-e813-4814-8477-3c16db27a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.222593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 907/1842] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:16.231269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f8864-e813-4814-8477-3c16db27a634 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.240853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177dc7e69bbb4545ab551bc4f6d21ac0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:16.248964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f8864-e813-4814-8477-3c16db27a634 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.251236 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d3bf31dd-734e-48ba-aed0-0d4148863f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177dc7e69bbb4545ab551bc4f6d21ac0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:16.255490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b6260-f8a7-4192-94e5-fa421204003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.256155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b6260-f8a7-4192-94e5-fa421204003d admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.256429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b6260-f8a7-4192-94e5-fa421204003d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.256701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b6260-f8a7-4192-94e5-fa421204003d admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.258010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b6260-f8a7-4192-94e5-fa421204003d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.259724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b6260-f8a7-4192-94e5-fa421204003d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.261214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 936/1843] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:15 2022] DELETE /identity/v3/users/177dc7e69bbb4545ab551bc4f6d21ac0 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:16.262964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675499-ac20-4586-a3a0-19884c9f2212 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.263740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675499-ac20-4586-a3a0-19884c9f2212 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.264263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0675499-ac20-4586-a3a0-19884c9f2212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.274722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 908/1844] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:16.274722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.274722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.274722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.297585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:16.299163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.303855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b0675499-ac20-4586-a3a0-19884c9f2212 None None] MFA Rules not processed for user `697fcc0a3e2643358adf6498f8d0a0de`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:16.305279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b0675499-ac20-4586-a3a0-19884c9f2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.430852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 937/1845] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:16.430852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968597-30d6-4f8d-9ca9-4d9224f65a5b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.430852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968597-30d6-4f8d-9ca9-4d9224f65a5b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.430852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f968597-30d6-4f8d-9ca9-4d9224f65a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.453683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 909/1846] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:16.454701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.457280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.474080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-6f968597-30d6-4f8d-9ca9-4d9224f65a5b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:16.475285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6f968597-30d6-4f8d-9ca9-4d9224f65a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.482228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2fd48-aa5b-4021-a2df-364592f4099a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.488177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 938/1847] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:16.488177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968597-30d6-4f8d-9ca9-4d9224f65a5b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.496164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f968597-30d6-4f8d-9ca9-4d9224f65a5b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.498765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.499397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.499735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.499967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.500618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.502595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.502725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.504686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.510862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.510862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.510862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:16.510862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.510862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.515030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 910/1848] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:16.516089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.522064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 939/1849] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:16.522954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.526527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.528457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.618292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88fdcb-caf5-4449-be01-7e7385f6abae admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.624730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.625953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.626438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.626935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.638278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaa700-9293-4478-baf4-017a83f97620 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.643738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.644792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.645247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.646313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.646651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.646980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.655833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 940/1850] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:16.656698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.658307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.659992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.666745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297be36-5a2b-4a07-9254-52b3b09c4a9e service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.672199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 911/1851] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:16 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:16.672464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd734a1c-1aac-42c1-85e1-11b93d778544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.673141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734a1c-1aac-42c1-85e1-11b93d778544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.673556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734a1c-1aac-42c1-85e1-11b93d778544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.673835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734a1c-1aac-42c1-85e1-11b93d778544 admin admin] PATH_INFO: `/v3/projects/455e722621ba4fdbb92eac3118b4be65/users/89c8f1b22d1240f3ac0b9e7a0409f0be/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.679585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:16.691645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.694961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd734a1c-1aac-42c1-85e1-11b93d778544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455e722621ba4fdbb92eac3118b4be65, user_id=89c8f1b22d1240f3ac0b9e7a0409f0be, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.698477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd734a1c-1aac-42c1-85e1-11b93d778544 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.712909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10a5c1-5972-493b-bdf9-c90e4f370436 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.720108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.723900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.724495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.725340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.726146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.728208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:16.803607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 941/1852] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:16 2022] PUT /identity/v3/projects/455e722621ba4fdbb92eac3118b4be65/users/89c8f1b22d1240f3ac0b9e7a0409f0be/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:16.813623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5dc3d-283a-4daa-8b84-501fc0f7c94d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.814220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5dc3d-283a-4daa-8b84-501fc0f7c94d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.814220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5dc3d-283a-4daa-8b84-501fc0f7c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.844512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-faf5dc3d-283a-4daa-8b84-501fc0f7c94d None None] MFA Rules not processed for user `89c8f1b22d1240f3ac0b9e7a0409f0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:16.845760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-faf5dc3d-283a-4daa-8b84-501fc0f7c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:16.864967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 912/1853] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:16.866190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.953901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 942/1854] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:16.954059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ab0ab-6b76-419b-8b08-6983fc0af38a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:16.959935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5dc3d-283a-4daa-8b84-501fc0f7c94d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:16.969307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:16.969963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:16.970249 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:16.971585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:16.972962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:16.981464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.053703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5dc3d-283a-4daa-8b84-501fc0f7c94d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.061152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.061779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.062063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.062337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.063186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.065081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.109558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 913/1855] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/users => generated 282 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:17.112120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.165231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10676a13-a341-4bc1-954c-7d97d4a82cf2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.168884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.169491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.169767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.170040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.171769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:17.208847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 943/1856] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:16 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:17.208847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.234490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.235879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.247600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 914/1857] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:17 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:17.248667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.262310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469266-7875-42d2-b26d-4c2bbe62c769 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.290532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606131a-03ea-4e87-a743-e94ee281d64b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.297626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.298553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.299073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.299351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.300109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.301740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.312212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 944/1858] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:17.313061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.314741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:17.325658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.326401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.326680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.326948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.327578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.329542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.330571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931f49b-5aad-4053-b3dc-1eacf7d8666e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.337064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.337713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.338428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.340845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] PATH_INFO: `/v3/projects/7ee7c6571db6475d8ca0ade97672479c` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.343935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee7c6571db6475d8ca0ade97672479c)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.346183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.482934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 915/1859] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:17 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:17.484292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.497144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118fdc8-be07-464f-86f1-6bf8185dc3a9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.502159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.503046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.503451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.503818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.504610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.506337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.519928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 916/1860] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:17.521225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.537892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b296c-28af-483c-b90c-05c4f67ab851 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.556820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee7c6571db6475d8ca0ade97672479c', 'request_id': 'req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:17.567389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee7c6571db6475d8ca0ade97672479c', 'request_id': 'req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:17.609120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.610162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.611314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.611577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.612265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.616607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.626870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 917/1861] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:17.631535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.642855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73055c8-d097-43ca-9813-067d10f983d5 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.649747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de931-e5e4-4971-a2c6-83832984327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.650709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de931-e5e4-4971-a2c6-83832984327e admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.650991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de931-e5e4-4971-a2c6-83832984327e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.651265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de931-e5e4-4971-a2c6-83832984327e admin admin] PATH_INFO: `/v3/projects/b62441ceef834be1a3050c841a72c617/users/ab843bd8e2b1475593168ed1bb2930d0/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.667230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de931-e5e4-4971-a2c6-83832984327e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62441ceef834be1a3050c841a72c617, user_id=ab843bd8e2b1475593168ed1bb2930d0, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.670349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de931-e5e4-4971-a2c6-83832984327e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.715783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee7c6571db6475d8ca0ade97672479c', 'request_id': 'req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:17.730819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] The token cache is being invalidate because project 7ee7c6571db6475d8ca0ade97672479c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:17.731832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:17.732602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:17.734424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 945/1862] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:17 2022] DELETE /identity/v3/projects/7ee7c6571db6475d8ca0ade97672479c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:17.740363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.742323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:17.754835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 918/1863] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:17 2022] PUT /identity/v3/projects/b62441ceef834be1a3050c841a72c617/users/ab843bd8e2b1475593168ed1bb2930d0/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:17.756914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c061-ac0a-4c98-85c3-1cfc310b0231 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.757202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c061-ac0a-4c98-85c3-1cfc310b0231 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.757474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682c061-ac0a-4c98-85c3-1cfc310b0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.760958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ab4d4-c919-4fe1-b5b2-f66c0a72dad6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.781534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e682c061-ac0a-4c98-85c3-1cfc310b0231 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:17.783197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e682c061-ac0a-4c98-85c3-1cfc310b0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:17.828388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c0901-cf0e-4d87-a504-2bc6396be104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.829241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0901-cf0e-4d87-a504-2bc6396be104 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.829753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0901-cf0e-4d87-a504-2bc6396be104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.830158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c0901-cf0e-4d87-a504-2bc6396be104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.831000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c0901-cf0e-4d87-a504-2bc6396be104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.833480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c0901-cf0e-4d87-a504-2bc6396be104 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.850957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 946/1864] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:17.850957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04220-29a3-4830-b175-b65ef2e5b5ce None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.850957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04220-29a3-4830-b175-b65ef2e5b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.850957 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04220-29a3-4830-b175-b65ef2e5b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.884708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-94d04220-29a3-4830-b175-b65ef2e5b5ce None None] MFA Rules not processed for user `ab843bd8e2b1475593168ed1bb2930d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:17.886151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 919/1865] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:17.886303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-94d04220-29a3-4830-b175-b65ef2e5b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:17.887281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c061-ac0a-4c98-85c3-1cfc310b0231 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:17.897800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682c061-ac0a-4c98-85c3-1cfc310b0231 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:17.902570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:17.903231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.905153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.905445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] PATH_INFO: `/v3/projects/f15f28faf34d4705b223058e3bdf9eed/users/a5546e2dc75240d193fb786f6254c6d0/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.921712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15f28faf34d4705b223058e3bdf9eed, user_id=a5546e2dc75240d193fb786f6254c6d0, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:17.924504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:17.967322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 947/1866] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:17.968644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:17.968935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:17.969214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:17.990110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:17.991383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:17.999725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 948/1867] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:18.000619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.002000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:18.014113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861afe5-e8db-4824-8440-3e7018136afb None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.019444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41c8e1-96a4-4206-b5f1-00d3ab1e1344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.020072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41c8e1-96a4-4206-b5f1-00d3ab1e1344 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.020355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41c8e1-96a4-4206-b5f1-00d3ab1e1344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.020628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41c8e1-96a4-4206-b5f1-00d3ab1e1344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.021252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41c8e1-96a4-4206-b5f1-00d3ab1e1344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.023160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41c8e1-96a4-4206-b5f1-00d3ab1e1344 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.121522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 920/1868] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:17 2022] PUT /identity/v3/projects/f15f28faf34d4705b223058e3bdf9eed/users/a5546e2dc75240d193fb786f6254c6d0/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:18.122288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.173792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 949/1869] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:17 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:18.175197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f27b1-d301-409f-ad1c-57289dff2699 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.175649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f27b1-d301-409f-ad1c-57289dff2699 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.176106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f27b1-d301-409f-ad1c-57289dff2699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.186423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e1d19-6874-4fbf-8f86-b114325b3f17 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.204932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-878f27b1-d301-409f-ad1c-57289dff2699 None None] MFA Rules not processed for user `a5546e2dc75240d193fb786f6254c6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:18.206158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-878f27b1-d301-409f-ad1c-57289dff2699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:18.244198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.244815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.245099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.245376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.246061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:18.246367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.248170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.260273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 921/1870] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:18.261178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.271107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 950/1871] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:18.272004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f27b1-d301-409f-ad1c-57289dff2699 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.272223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e85d68-a3e4-4462-b274-c62dba582649 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.278618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.281495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.281495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.281495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.281495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.282921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.287499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f27b1-d301-409f-ad1c-57289dff2699 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.292822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.293441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.293726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.293997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.294629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.296598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.353344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 922/1872] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:18 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:18.354376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.367341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15162bb-f083-44d5-a087-9f281355b49d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.372132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.372664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.372942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.373228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.373862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.375742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.419987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 951/1873] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:18 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:18.419987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.491400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a81324-8323-4295-8136-7001d08d6a6c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.497262 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.497907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.498192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.498472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.499126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.503694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.503857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 923/1874] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:18 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:18.503857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.516383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 952/1875] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:18.516383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.528275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141ee89-dca9-41ec-8d6f-32bda85c5c50 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.583984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201549a-7cbf-4801-8304-8f01a22694ea admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.590205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.590352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.590871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.590973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.591148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.591242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.591422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.591526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.592086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.592766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.594128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.594450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.718585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 953/1876] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:18 2022] POST /identity/v3/users => generated 300 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:18.720107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.727676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 924/1877] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:18 2022] POST /identity/v3/users => generated 280 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:18.727676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.737086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01bc28-7a56-4782-9c64-64574eff68ee admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.743960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01caff7e-89a4-4137-9bad-cf437df555ac admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.744881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.745922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.746378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.746665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] PATH_INFO: `/v3/projects/abd52388a3bf4450a33dd860c5a278e2/users/1793180dc46341229f11ffab01f2e87e/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.751448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.752368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.754137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.754137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.755187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.757579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.766053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd52388a3bf4450a33dd860c5a278e2, user_id=1793180dc46341229f11ffab01f2e87e, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.769558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.771305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 925/1878] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:18.772537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.783747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241bec4-a950-413c-9451-b1180d12e428 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.789278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.789716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.789999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.790274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.791668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.793987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.806372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 926/1879] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:18.807357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.824711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259e868-3564-44bc-ae67-82eacef24e1f admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.829652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c7e78-99c1-4ac0-b202-295d0a57e5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.830396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c7e78-99c1-4ac0-b202-295d0a57e5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.830681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c7e78-99c1-4ac0-b202-295d0a57e5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.830953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c7e78-99c1-4ac0-b202-295d0a57e5b2 admin admin] PATH_INFO: `/v3/projects/dc3268ffed3c435db2c2839bbdbf19b7/users/c16a12611be648e888c4526af87827dd/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.847672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c7e78-99c1-4ac0-b202-295d0a57e5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3268ffed3c435db2c2839bbdbf19b7, user_id=c16a12611be648e888c4526af87827dd, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.851169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c7e78-99c1-4ac0-b202-295d0a57e5b2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.855005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 954/1880] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:18 2022] PUT /identity/v3/projects/abd52388a3bf4450a33dd860c5a278e2/users/1793180dc46341229f11ffab01f2e87e/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:18.856251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.950570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18b6e0-8e49-4315-b7c7-b96b39d0d2e3 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:18.957160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:18.957941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.958241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.958493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.959506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:18.960977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:18.971365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 955/1881] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:18.972673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.983155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 927/1882] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:18 2022] PUT /identity/v3/projects/dc3268ffed3c435db2c2839bbdbf19b7/users/c16a12611be648e888c4526af87827dd/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:18.983155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d16f1-aede-4b73-b30d-4647500f9744 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:18.983155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d16f1-aede-4b73-b30d-4647500f9744 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:18.983155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d16f1-aede-4b73-b30d-4647500f9744 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:18.984478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 928/1883] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:14:18.984587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d16f1-aede-4b73-b30d-4647500f9744 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:18.991853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4bac8-77ee-4552-b505-f3bb0fe67290 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.009847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:19.103377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d16f1-aede-4b73-b30d-4647500f9744 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.103497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.104078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.104478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.104766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.105477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.107563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.112656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.113342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.113626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.113904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] PATH_INFO: `/v3/projects/7292c902915148328014129efe66abc0/users/e8ed72f07a2d4262a656b6f80f526790/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.120567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 956/1884] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:19.124734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.133868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d0f2-167e-405f-8a3d-7ecaa721aa1b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.136829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7292c902915148328014129efe66abc0, user_id=e8ed72f07a2d4262a656b6f80f526790, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.138865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f72e3-f017-449e-9a50-43572539e3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.139432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f72e3-f017-449e-9a50-43572539e3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.139715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f72e3-f017-449e-9a50-43572539e3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.140179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.140665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f72e3-f017-449e-9a50-43572539e3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.141364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f72e3-f017-449e-9a50-43572539e3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.142920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f72e3-f017-449e-9a50-43572539e3d9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.155950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 957/1885] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:19.156337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aea60a-7a13-491d-b1aa-97cc3c7c62f5 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.156629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aea60a-7a13-491d-b1aa-97cc3c7c62f5 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.156912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aea60a-7a13-491d-b1aa-97cc3c7c62f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.179094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-65aea60a-7a13-491d-b1aa-97cc3c7c62f5 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:19.180360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-65aea60a-7a13-491d-b1aa-97cc3c7c62f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:19.231532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 929/1886] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:18 2022] PUT /identity/v3/projects/7292c902915148328014129efe66abc0/users/e8ed72f07a2d4262a656b6f80f526790/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:19.231532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.278300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 958/1887] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:19.279155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aea60a-7a13-491d-b1aa-97cc3c7c62f5 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.290297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aea60a-7a13-491d-b1aa-97cc3c7c62f5 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.302117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6b991-4501-4306-a43e-c2b57b97bfa9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.302300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d839a-b76d-41cb-bef6-ecfd2972c0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.302833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d839a-b76d-41cb-bef6-ecfd2972c0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.303098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d839a-b76d-41cb-bef6-ecfd2972c0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.303374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d839a-b76d-41cb-bef6-ecfd2972c0d8 admin admin] PATH_INFO: `/v3/projects/dc3268ffed3c435db2c2839bbdbf19b7/users/c16a12611be648e888c4526af87827dd/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.306332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d839a-b76d-41cb-bef6-ecfd2972c0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3268ffed3c435db2c2839bbdbf19b7, user_id=c16a12611be648e888c4526af87827dd, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.307832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.308612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.308965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.309315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] PATH_INFO: `/v3/projects/abd52388a3bf4450a33dd860c5a278e2/users/1793180dc46341229f11ffab01f2e87e/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.309424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d839a-b76d-41cb-bef6-ecfd2972c0d8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.311391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd52388a3bf4450a33dd860c5a278e2, user_id=1793180dc46341229f11ffab01f2e87e, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.314154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.321229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 959/1888] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:19 2022] PUT /identity/v3/projects/dc3268ffed3c435db2c2839bbdbf19b7/users/c16a12611be648e888c4526af87827dd/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:19.322139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0be10-8ae6-4433-b013-e7e48b17c846 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.322431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0be10-8ae6-4433-b013-e7e48b17c846 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.323036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0be10-8ae6-4433-b013-e7e48b17c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.332296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 930/1889] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:19 2022] PUT /identity/v3/projects/abd52388a3bf4450a33dd860c5a278e2/users/1793180dc46341229f11ffab01f2e87e/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:19.333511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.335953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:19.359488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-33d0be10-8ae6-4433-b013-e7e48b17c846 None None] MFA Rules not processed for user `e8ed72f07a2d4262a656b6f80f526790`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:19.361330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-33d0be10-8ae6-4433-b013-e7e48b17c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:19.420684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155596-9541-4bf9-89e1-5caf9f66bdb4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.427722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7f7d8-b49b-431a-a0c6-987e1094a5ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.428463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f7d8-b49b-431a-a0c6-987e1094a5ce service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.428830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f7d8-b49b-431a-a0c6-987e1094a5ce service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.429178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7f7d8-b49b-431a-a0c6-987e1094a5ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.439193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7f7d8-b49b-431a-a0c6-987e1094a5ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.441434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7f7d8-b49b-431a-a0c6-987e1094a5ce service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.453292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 931/1890] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:19.454731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.455082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.455441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.470707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 960/1891] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:19.475311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90e40-b768-408a-a29f-a966d3d21b4f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.476278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90e40-b768-408a-a29f-a966d3d21b4f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.477159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90e40-b768-408a-a29f-a966d3d21b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.493898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] MFA Rules not processed for user `c16a12611be648e888c4526af87827dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:19.493898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:19.586899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 932/1892] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:19.588195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:19.592231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.593773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:19.594304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-92a90e40-b768-408a-a29f-a966d3d21b4f None None] MFA Rules not processed for user `1793180dc46341229f11ffab01f2e87e`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:19.595581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-92a90e40-b768-408a-a29f-a966d3d21b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:19.653847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9246717-c9ce-480e-bde4-2f7d5ba3f6c6 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.657358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.657968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.658242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.658560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.666875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.668346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.668901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 961/1893] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:19.678060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 933/1894] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:19.694771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a90e40-b768-408a-a29f-a966d3d21b4f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.734057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.736452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:19.751463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad992752-e465-46e1-aab1-daa44109fb2c service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.756334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.757118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.757397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.757671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.769875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.771828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.785938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 934/1895] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:19.793184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a90e40-b768-408a-a29f-a966d3d21b4f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.798126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.798769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.799060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.799317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] PATH_INFO: `/v3/users/e8ed72f07a2d4262a656b6f80f526790` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.800762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ed72f07a2d4262a656b6f80f526790)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.802721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.835227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:19.844103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ce7e7-39b8-4e6e-a432-8078758b0fd5 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:19.848180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995f5a8-0740-4adc-bbca-8f8ad9984ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:19.848784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f5a8-0740-4adc-bbca-8f8ad9984ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:19.849062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f5a8-0740-4adc-bbca-8f8ad9984ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:19.849334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995f5a8-0740-4adc-bbca-8f8ad9984ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:19.858583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995f5a8-0740-4adc-bbca-8f8ad9984ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:19.860047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995f5a8-0740-4adc-bbca-8f8ad9984ee0 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:19.871024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 935/1896] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:20.101932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ed72f07a2d4262a656b6f80f526790'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:20.114786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ed72f07a2d4262a656b6f80f526790'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:20.115468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ed72f07a2d4262a656b6f80f526790'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:20.258229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ed72f07a2d4262a656b6f80f526790'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:20.267285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ed72f07a2d4262a656b6f80f526790'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:20.287395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 962/1897] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:19 2022] DELETE /identity/v3/users/e8ed72f07a2d4262a656b6f80f526790 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:20.292361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:20.292631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:20.292912 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:20.321042 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:20.322660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:20.402254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 936/1898] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:20.412964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:20.414584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:20.473139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:20.474488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:20.486958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f71af8-fee7-4f0a-9721-84dd99566e20 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:20.491571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:20.496595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:20.496595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:20.496595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:20.503791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:20.505386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:20.531654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 963/1899] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:20.538140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d3f8e-731e-4b74-93e2-eecfc8540d99 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:20.542584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5445d-e5fe-4c33-af04-6d941c43b700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:20.543206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5445d-e5fe-4c33-af04-6d941c43b700 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:20.543485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5445d-e5fe-4c33-af04-6d941c43b700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:20.543757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5445d-e5fe-4c33-af04-6d941c43b700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:20.545583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e1c5445d-e5fe-4c33-af04-6d941c43b700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:20.634487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5445d-e5fe-4c33-af04-6d941c43b700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:20.636121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5445d-e5fe-4c33-af04-6d941c43b700 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:20.648423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 937/1900] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:21.025384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:21.025384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:21.049116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23b00a-1028-4dad-ab88-2118c66ba826 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:21.061990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:21.062722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:21.062974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:21.063166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] PATH_INFO: `/v3/projects/7292c902915148328014129efe66abc0` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:21.064400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7292c902915148328014129efe66abc0)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:21.066725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:21.279937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7292c902915148328014129efe66abc0', 'request_id': 'req-92d91091-ae7a-473c-9394-4fce3486af26'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:21.287362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7292c902915148328014129efe66abc0', 'request_id': 'req-92d91091-ae7a-473c-9394-4fce3486af26'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:21.465289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7292c902915148328014129efe66abc0', 'request_id': 'req-92d91091-ae7a-473c-9394-4fce3486af26'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:21.477893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] The token cache is being invalidate because project 7292c902915148328014129efe66abc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:21.478503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:21.479083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92d91091-ae7a-473c-9394-4fce3486af26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:21.480607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 964/1901] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:21 2022] DELETE /identity/v3/projects/7292c902915148328014129efe66abc0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:21.492113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe81c-8e14-42b7-ac69-dde6f911c8e4 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:21.492658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe81c-8e14-42b7-ac69-dde6f911c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:21.492658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe81c-8e14-42b7-ac69-dde6f911c8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:21.512570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-53afe81c-8e14-42b7-ac69-dde6f911c8e4 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:21.513775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-53afe81c-8e14-42b7-ac69-dde6f911c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:21.579959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 938/1902] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:21.590598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30730-7403-4e03-ac76-46f24c36de4d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:21.591119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30730-7403-4e03-ac76-46f24c36de4d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:21.591572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a30730-7403-4e03-ac76-46f24c36de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:21.631235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-80a30730-7403-4e03-ac76-46f24c36de4d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:21.633300 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-80a30730-7403-4e03-ac76-46f24c36de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:21.647573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afe81c-8e14-42b7-ac69-dde6f911c8e4 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:21.648249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 965/1903] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:21.659266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afe81c-8e14-42b7-ac69-dde6f911c8e4 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:21.677044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:21.677761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:21.678106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:21.678384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:21.679069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:21.679393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:21.682475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:21.695785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 939/1904] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:21.700462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30730-7403-4e03-ac76-46f24c36de4d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:21.716589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a30730-7403-4e03-ac76-46f24c36de4d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:21.730049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:21.730749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:21.731033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:21.731315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:21.732028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:21.733924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:21.848877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 966/1905] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:21 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:21.850895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:21.874645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85b3db-aa4a-46e5-81a4-e92ca35ffaf3 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:21.938151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:21.938759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:21.939035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:21.939305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:21.939988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:21.942583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:21.978706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:22.105680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 940/1906] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:21 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:22.109749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:22.124869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fb5d1-1d24-42ab-87fa-888725f2a2f0 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:22.131583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:22.132512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:22.132933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:22.133345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:22.134328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:22.136926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:22.162761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 967/1907] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:22.166927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:22.180144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fe3b7-5e5a-4cef-adf1-4baae8ff7ddc admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:22.184810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7d74-abb2-4235-a9e6-680bf6bfaee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:22.185431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7d74-abb2-4235-a9e6-680bf6bfaee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:22.185711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7d74-abb2-4235-a9e6-680bf6bfaee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:22.186073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7d74-abb2-4235-a9e6-680bf6bfaee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:22.186722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7d74-abb2-4235-a9e6-680bf6bfaee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:22.188447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7d74-abb2-4235-a9e6-680bf6bfaee6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:22.202731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 941/1908] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:22.203867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:22.214433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83664f-49be-4e4e-bc87-7f17801ad259 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:22.219184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:22.219871 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:22.220272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:22.220569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] PATH_INFO: `/v3/projects/0398fa23dddb438aa64d4588aa1cf628/users/e63d07fb4e55489e96e59a5e53a09023/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:22.236692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0398fa23dddb438aa64d4588aa1cf628, user_id=e63d07fb4e55489e96e59a5e53a09023, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:22.240049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:22.397098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 968/1909] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:22 2022] PUT /identity/v3/projects/0398fa23dddb438aa64d4588aa1cf628/users/e63d07fb4e55489e96e59a5e53a09023/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:22.398187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:22.398476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:22.398762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:22.436429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] MFA Rules not processed for user `e63d07fb4e55489e96e59a5e53a09023`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:22.438031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:22.536475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 942/1910] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:22.635757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:22.637537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:22.678492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:22.747175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94ccbc-917e-4378-ba72-bcbb6884431a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:22.756480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:22.757317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:22.757603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:22.757885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:22.766890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:22.768397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:22.782404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 969/1911] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:23.351726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:23.353278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:23.366152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a9b48-4cea-497c-8203-6fa57626d224 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:23.369798 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960e3dc-7ecc-445d-a043-64d508cbf5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:23.370454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960e3dc-7ecc-445d-a043-64d508cbf5ea service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:23.370734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960e3dc-7ecc-445d-a043-64d508cbf5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:23.371006 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960e3dc-7ecc-445d-a043-64d508cbf5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:23.372740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0960e3dc-7ecc-445d-a043-64d508cbf5ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:23.441118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960e3dc-7ecc-445d-a043-64d508cbf5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:23.443207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960e3dc-7ecc-445d-a043-64d508cbf5ea service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:23.454060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 943/1912] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:23.683111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:24.401184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:24.404004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:24.492663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46262df-eae3-4c03-953e-2f6e432ffc7c service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:24.497220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:24.497922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:24.498199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:24.498491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] PATH_INFO: `/v3/users/7f6fb8b1935e41b994c13a3ab6073718` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:24.499602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6fb8b1935e41b994c13a3ab6073718)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:24.501697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:24.839526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6fb8b1935e41b994c13a3ab6073718'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:24.867532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6fb8b1935e41b994c13a3ab6073718'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:24.870184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6fb8b1935e41b994c13a3ab6073718'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:25.031460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6fb8b1935e41b994c13a3ab6073718'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:25.045036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6fb8b1935e41b994c13a3ab6073718'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:25.053777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 970/1913] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:24 2022] DELETE /identity/v3/users/7f6fb8b1935e41b994c13a3ab6073718 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:25.057897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:25.058405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:25.058507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:25.081883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:25.083431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:25.167443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 944/1914] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:25.178534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:25.180025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:25.246899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94e0b4-1a54-4ac8-b90b-d0cb6bd1a8b1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:25.251649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:25.252054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:25.252481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:25.253482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:25.264298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:25.265906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:25.278246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 971/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:25.676284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:25.884875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:25.886452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:25.904202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82e7b7-ef76-4d07-9e7b-53f97ccccc53 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:25.924132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:25.926506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:25.926950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:25.927643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] PATH_INFO: `/v3/projects/9083fc8a03bc41008e05c18b4c10f269` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:25.929844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9083fc8a03bc41008e05c18b4c10f269)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:25.934170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:26.183448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9083fc8a03bc41008e05c18b4c10f269', 'request_id': 'req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.194074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9083fc8a03bc41008e05c18b4c10f269', 'request_id': 'req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.320800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9083fc8a03bc41008e05c18b4c10f269', 'request_id': 'req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.336552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] The token cache is being invalidate because project 9083fc8a03bc41008e05c18b4c10f269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:26.336852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.337909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.342855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 945/1916] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:25 2022] DELETE /identity/v3/projects/9083fc8a03bc41008e05c18b4c10f269 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:26.344093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:26.358369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd5b9f-5751-435e-b1f1-b58718f51309 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:26.431224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:26.431867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:26.432192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:26.432530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] PATH_INFO: `/v3/users/697fcc0a3e2643358adf6498f8d0a0de` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:26.433678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=697fcc0a3e2643358adf6498f8d0a0de)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:26.435758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:26.707041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697fcc0a3e2643358adf6498f8d0a0de'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.730227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:26.731833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:26.734912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697fcc0a3e2643358adf6498f8d0a0de'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.741631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697fcc0a3e2643358adf6498f8d0a0de'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.750846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd89976-8ad7-4b9e-94e0-241de4ffa3b8 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:26.757514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:26.758465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:26.758887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:26.759297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] PATH_INFO: `/v3/users/ab843bd8e2b1475593168ed1bb2930d0` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:26.761168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab843bd8e2b1475593168ed1bb2930d0)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:26.763483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:26.790752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:26.854662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697fcc0a3e2643358adf6498f8d0a0de'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.854662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d4d00d57-c3b3-488e-ac6a-d50f38a6ea5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697fcc0a3e2643358adf6498f8d0a0de'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.865549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 972/1917] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:26 2022] DELETE /identity/v3/users/697fcc0a3e2643358adf6498f8d0a0de => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:26.994587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab843bd8e2b1475593168ed1bb2930d0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.995510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab843bd8e2b1475593168ed1bb2930d0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:26.996203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab843bd8e2b1475593168ed1bb2930d0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.176433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab843bd8e2b1475593168ed1bb2930d0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.188534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab843bd8e2b1475593168ed1bb2930d0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.220906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 946/1918] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:26 2022] DELETE /identity/v3/users/ab843bd8e2b1475593168ed1bb2930d0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:27.223423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:27.223720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:27.224033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:27.275840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:27.280880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:27.410809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 973/1919] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:27.420811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:27.422257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:27.484583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b1ed0-8d00-4868-90ce-a62eae36bee7 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:27.488897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2ddb9-5252-4fd1-a8fa-5247ae4526ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:27.489513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2ddb9-5252-4fd1-a8fa-5247ae4526ba service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:27.504138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2ddb9-5252-4fd1-a8fa-5247ae4526ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:27.504138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2ddb9-5252-4fd1-a8fa-5247ae4526ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:27.504138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2ddb9-5252-4fd1-a8fa-5247ae4526ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:27.504138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2ddb9-5252-4fd1-a8fa-5247ae4526ba service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:27.512500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 947/1920] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:27.647573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:27.649572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:27.665954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7778-a5d2-4f1c-8268-cc6319f98111 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:27.674192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:27.675613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:27.675970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:27.676373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] PATH_INFO: `/v3/projects/72e8bdb541e641b4a8d2bc21576a9e82` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:27.677770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e8bdb541e641b4a8d2bc21576a9e82)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:27.679930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:27.757879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:27.847704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e8bdb541e641b4a8d2bc21576a9e82', 'request_id': 'req-0f6f44dc-7726-4f38-aa19-21b0ea657044'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.867974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e8bdb541e641b4a8d2bc21576a9e82', 'request_id': 'req-0f6f44dc-7726-4f38-aa19-21b0ea657044'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.945368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e8bdb541e641b4a8d2bc21576a9e82', 'request_id': 'req-0f6f44dc-7726-4f38-aa19-21b0ea657044'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.967674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] The token cache is being invalidate because project 72e8bdb541e641b4a8d2bc21576a9e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:27.968169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.968754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f6f44dc-7726-4f38-aa19-21b0ea657044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:27.970702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 974/1921] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:27 2022] DELETE /identity/v3/projects/72e8bdb541e641b4a8d2bc21576a9e82 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:27.976823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280deab8-a002-42f8-8ca0-4aff3c79097d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:27.977195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280deab8-a002-42f8-8ca0-4aff3c79097d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:27.977835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280deab8-a002-42f8-8ca0-4aff3c79097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.021791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-280deab8-a002-42f8-8ca0-4aff3c79097d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:28.027727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-280deab8-a002-42f8-8ca0-4aff3c79097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:28.121246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 948/1922] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:28.130093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.130383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.130660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.156861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:28.158123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:28.167060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 975/1923] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:28.171459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280deab8-a002-42f8-8ca0-4aff3c79097d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.181683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280deab8-a002-42f8-8ca0-4aff3c79097d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.186510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.187122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.187399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.187673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.188366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:28.188867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.191084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.209761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 949/1924] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:28.212271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.213541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.215887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:28.232594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3f962-e08d-4782-b698-a6ef83563ca0 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.236930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32602d52-2ffb-4d6b-baf3-e854b9bf3251 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.238698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.239572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.239744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.240148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] PATH_INFO: `/v3/projects/b62441ceef834be1a3050c841a72c617` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.241817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62441ceef834be1a3050c841a72c617)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.243752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.246282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.247320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.247779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.248469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.249863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.253642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.445586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 950/1925] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:28 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:28.450040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.459501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62441ceef834be1a3050c841a72c617', 'request_id': 'req-742af665-c6b7-46b9-8785-99df0e07c21e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:28.467153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62441ceef834be1a3050c841a72c617', 'request_id': 'req-742af665-c6b7-46b9-8785-99df0e07c21e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:28.521931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0f346-ac8c-4b86-be3b-2b2e39ac3d6f admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.527122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.527722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.528049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.528314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.528955 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.531014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.583407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62441ceef834be1a3050c841a72c617', 'request_id': 'req-742af665-c6b7-46b9-8785-99df0e07c21e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:28.595004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] The token cache is being invalidate because project b62441ceef834be1a3050c841a72c617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:28.595429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:28.596183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:28.598563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 976/1926] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:28 2022] DELETE /identity/v3/projects/b62441ceef834be1a3050c841a72c617 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:28.602625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.604151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:28.668945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742af665-c6b7-46b9-8785-99df0e07c21e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.673743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.674433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.675232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.675508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] PATH_INFO: `/v3/users/1793180dc46341229f11ffab01f2e87e` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.676763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1793180dc46341229f11ffab01f2e87e)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.678698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.692952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 951/1927] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:28 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:28.694247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.696116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:28.708451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de671967-384c-4668-a87e-e2a9ce15c885 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.713286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.714298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.714580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.714849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.716214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.718026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.745968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 952/1928] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:28.754101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.760278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f413f-f963-411a-8546-7bd580a78575 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.765624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.766247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.766554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.766800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.767465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.769880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.781494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 953/1929] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:28.786286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:28.796118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad0d7e-7d88-4063-bc96-b4a52ec18697 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:28.801485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570b4c2-81cd-46ca-9871-769a2b26d56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:28.802226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b4c2-81cd-46ca-9871-769a2b26d56b admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.802578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b4c2-81cd-46ca-9871-769a2b26d56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.802918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570b4c2-81cd-46ca-9871-769a2b26d56b admin admin] PATH_INFO: `/v3/projects/bc9d62760e234275ae6b640421d2b4ca/users/35c58c2c199f4560b1ab7eca663165f2/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.818985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570b4c2-81cd-46ca-9871-769a2b26d56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9d62760e234275ae6b640421d2b4ca, user_id=35c58c2c199f4560b1ab7eca663165f2, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:28.821785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1570b4c2-81cd-46ca-9871-769a2b26d56b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:28.939589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 954/1930] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:28 2022] PUT /identity/v3/projects/bc9d62760e234275ae6b640421d2b4ca/users/35c58c2c199f4560b1ab7eca663165f2/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:28.950472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34873f2b-e3a8-4a79-a73a-f851b3d8e4c9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:28.950765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34873f2b-e3a8-4a79-a73a-f851b3d8e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:28.951052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34873f2b-e3a8-4a79-a73a-f851b3d8e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:28.984656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1793180dc46341229f11ffab01f2e87e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:28.988763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-34873f2b-e3a8-4a79-a73a-f851b3d8e4c9 None None] MFA Rules not processed for user `35c58c2c199f4560b1ab7eca663165f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:28.990136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-34873f2b-e3a8-4a79-a73a-f851b3d8e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:28.998435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1793180dc46341229f11ffab01f2e87e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:28.999142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1793180dc46341229f11ffab01f2e87e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.057317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 955/1931] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:29.061705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34873f2b-e3a8-4a79-a73a-f851b3d8e4c9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:29.134117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1793180dc46341229f11ffab01f2e87e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.134311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34873f2b-e3a8-4a79-a73a-f851b3d8e4c9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:29.139960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:29.140681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.140857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.152997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:29.152997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:29.152997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:29.153540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1793180dc46341229f11ffab01f2e87e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.153540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 977/1932] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:28 2022] DELETE /identity/v3/users/1793180dc46341229f11ffab01f2e87e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:29.318096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 956/1933] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:29 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:29.322358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:29.323774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:29.391812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f849-ee6d-4892-876b-0d2956f263eb admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:29.460959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:29.463223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.463864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.464203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:29.465152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:29.468525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:29.605051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 978/1934] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:29 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:29.607206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:29.618130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d33a5d-9e75-477d-a7bd-dcdd1bcf6a6c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:29.622777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:29.623416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.624007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.624306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:29.624959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:29.626584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:29.634704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:29.638112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:29.642418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 957/1935] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:29.645623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:29.657524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120c6f1-9217-40ad-bdce-3a119819ed8c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:29.662369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cdf0f-905c-4c23-b48b-3a1e13398acf admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:29.663227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:29.663975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.664218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.664485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:29.665159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:29.666780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:29.668415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:29.669209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.669577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.669898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] PATH_INFO: `/v3/projects/abd52388a3bf4450a33dd860c5a278e2` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:29.671047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd52388a3bf4450a33dd860c5a278e2)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:29.672998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:29.680603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 958/1936] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:29.686806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:29.697570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296adc-847e-4d8e-b162-203433f4d23d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:29.702752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166db617-23f9-43d5-861f-3b47ecb2518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:29.703490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166db617-23f9-43d5-861f-3b47ecb2518d admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.704072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166db617-23f9-43d5-861f-3b47ecb2518d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.704355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166db617-23f9-43d5-861f-3b47ecb2518d admin admin] PATH_INFO: `/v3/projects/9c2849a3c2ec40aab7c331868be492f9/users/908c51bf3270480c926b81b3eec8a46f/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:29.720348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166db617-23f9-43d5-861f-3b47ecb2518d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2849a3c2ec40aab7c331868be492f9, user_id=908c51bf3270480c926b81b3eec8a46f, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:29.723138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166db617-23f9-43d5-861f-3b47ecb2518d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:29.841115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:29.854029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 959/1937] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:29 2022] PUT /identity/v3/projects/9c2849a3c2ec40aab7c331868be492f9/users/908c51bf3270480c926b81b3eec8a46f/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:29.854577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd52388a3bf4450a33dd860c5a278e2', 'request_id': 'req-0f0bd63c-9555-40e1-b336-e6b20b997fa9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.857854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ab207-0788-42aa-a0ec-2e9fff813f67 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.858286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ab207-0788-42aa-a0ec-2e9fff813f67 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.858382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ab207-0788-42aa-a0ec-2e9fff813f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:29.863389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd52388a3bf4450a33dd860c5a278e2', 'request_id': 'req-0f0bd63c-9555-40e1-b336-e6b20b997fa9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.889330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5c1ab207-0788-42aa-a0ec-2e9fff813f67 None None] MFA Rules not processed for user `908c51bf3270480c926b81b3eec8a46f`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:29.890659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5c1ab207-0788-42aa-a0ec-2e9fff813f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:29.960474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 960/1938] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:29.965004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ab207-0788-42aa-a0ec-2e9fff813f67 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:29.971186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd52388a3bf4450a33dd860c5a278e2', 'request_id': 'req-0f0bd63c-9555-40e1-b336-e6b20b997fa9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.984007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] The token cache is being invalidate because project abd52388a3bf4450a33dd860c5a278e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:29.984519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.985581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0f0bd63c-9555-40e1-b336-e6b20b997fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:29.988694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 979/1939] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:29 2022] DELETE /identity/v3/projects/abd52388a3bf4450a33dd860c5a278e2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:29.993731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d1ac-890e-4821-9488-de3a556fa980 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:29.994025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d1ac-890e-4821-9488-de3a556fa980 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:29.994343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5d1ac-890e-4821-9488-de3a556fa980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.015664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-37d5d1ac-890e-4821-9488-de3a556fa980 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:30.016930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-37d5d1ac-890e-4821-9488-de3a556fa980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:30.033053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ab207-0788-42aa-a0ec-2e9fff813f67 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.038428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.039141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.039493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.039833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.043241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.053295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.088970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 980/1940] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:30.099622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad96c8-5249-4b05-8fb4-e8294b22791b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.100043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad96c8-5249-4b05-8fb4-e8294b22791b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.100297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad96c8-5249-4b05-8fb4-e8294b22791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.120903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8fad96c8-5249-4b05-8fb4-e8294b22791b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:30.122115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8fad96c8-5249-4b05-8fb4-e8294b22791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:30.131200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 981/1941] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:30.147167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad96c8-5249-4b05-8fb4-e8294b22791b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.156438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad96c8-5249-4b05-8fb4-e8294b22791b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.161090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.161774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.162057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.162330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.162975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:30.163278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.164983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.185862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 982/1942] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:14:30.188807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.199450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48add1d9-423a-4fe3-9b6e-c02287c98097 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.204075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.204676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.204955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.205227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.205883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.207792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.235316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 961/1943] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:29 2022] POST /identity/v3/projects => generated 377 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:30.235594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:30.239544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.239544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:30.294904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34c3bf-0d25-4369-a310-374200db2c6a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.298597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.299215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.299527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.300936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.302704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:30.369415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.369415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.377639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 962/1944] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:30.378248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.379807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:30.386578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 983/1945] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:30 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:30.390784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.458483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83d23-a62f-4114-98d5-8150b29dda71 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.465067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.465745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.466024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.466299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.466965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.468250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc60bf-b991-4d73-b30a-32b172105489 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.469104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.475317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.488141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.488564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.488924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.489722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.491806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.615185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 984/1946] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:30 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:30.618507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 963/1947] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:30 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:30.619619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.622856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.630574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f065b-bb72-4338-b8cd-f52f032cfae1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.635380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.636029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.636466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.636894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.637550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.638941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167439d7-f831-4dc0-89dc-f3630206d228 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.639217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.645344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.646418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.646704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.648764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.648764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.650579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.651065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 985/1948] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:30.654929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.662313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 964/1949] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:30.666075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239b955-add8-4c24-bef8-09899ba77e80 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.666226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.671088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.671702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.677492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.677492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.677492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.677492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.677785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645af1c7-85d0-4b7b-a428-f07405e7d5b2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.681560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.682230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.682509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.682781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] PATH_INFO: `/v3/projects/6acf9313802b4e73afc3e6f458f6c2d6/users/41ccef96acae4f34b27184463b60c30a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.687018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 986/1950] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:30.691373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.703309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acf9313802b4e73afc3e6f458f6c2d6, user_id=41ccef96acae4f34b27184463b60c30a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.703550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe938e5a-ea7b-4f67-b474-0ce3411ee005 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.708349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.710668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df1ef2-361a-4309-9793-74647bb1aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.711368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1ef2-361a-4309-9793-74647bb1aa99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.711652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1ef2-361a-4309-9793-74647bb1aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.712152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df1ef2-361a-4309-9793-74647bb1aa99 admin admin] PATH_INFO: `/v3/projects/62473d28b9bd4818aecf4710447e5066/users/0fb1777eb60d4ac9b48a8c9ddbdc196f/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.728999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df1ef2-361a-4309-9793-74647bb1aa99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62473d28b9bd4818aecf4710447e5066, user_id=0fb1777eb60d4ac9b48a8c9ddbdc196f, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.731817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df1ef2-361a-4309-9793-74647bb1aa99 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.819526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 965/1951] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:30 2022] PUT /identity/v3/projects/6acf9313802b4e73afc3e6f458f6c2d6/users/41ccef96acae4f34b27184463b60c30a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:30.822664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 987/1952] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:30 2022] PUT /identity/v3/projects/62473d28b9bd4818aecf4710447e5066/users/0fb1777eb60d4ac9b48a8c9ddbdc196f/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:30.823797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.834189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a7ce-9e4c-402c-ac2e-61c9947cbe28 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.834477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a7ce-9e4c-402c-ac2e-61c9947cbe28 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.834755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a7ce-9e4c-402c-ac2e-61c9947cbe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.864081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-4160a7ce-9e4c-402c-ac2e-61c9947cbe28 None None] MFA Rules not processed for user `0fb1777eb60d4ac9b48a8c9ddbdc196f`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:30.865202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4160a7ce-9e4c-402c-ac2e-61c9947cbe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:30.889596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fd73e-f6a5-4b36-9138-3214fd3081da admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.895431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.896169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.896449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.896719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.897438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.899379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.913511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 966/1953] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:30.914568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.925128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5ebcf-de66-49a5-8cbd-6d45f04077aa admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.929934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f850cd3-2775-4e39-a8f0-e7fb1a076781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:30.930589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850cd3-2775-4e39-a8f0-e7fb1a076781 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.930901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850cd3-2775-4e39-a8f0-e7fb1a076781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.931175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f850cd3-2775-4e39-a8f0-e7fb1a076781 admin admin] PATH_INFO: `/v3/projects/6acf9313802b4e73afc3e6f458f6c2d6/users/41ccef96acae4f34b27184463b60c30a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.933292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f850cd3-2775-4e39-a8f0-e7fb1a076781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acf9313802b4e73afc3e6f458f6c2d6, user_id=41ccef96acae4f34b27184463b60c30a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:30.934549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 988/1954] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:30.936758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f850cd3-2775-4e39-a8f0-e7fb1a076781 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:30.939233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160a7ce-9e4c-402c-ac2e-61c9947cbe28 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:30.949340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 967/1955] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:30 2022] PUT /identity/v3/projects/6acf9313802b4e73afc3e6f458f6c2d6/users/41ccef96acae4f34b27184463b60c30a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:30.951271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160a7ce-9e4c-402c-ac2e-61c9947cbe28 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:30.960448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:30.961138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:30.961593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:30.993258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] MFA Rules not processed for user `41ccef96acae4f34b27184463b60c30a`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:30.994619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:31.012237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.012859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.013141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.013415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.014050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.015995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.062689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 968/1956] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:31.074938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:31.076381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:31.133193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ddf5f-a842-422f-9327-ce8ecdf84dd4 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:31.136739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.137492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.137715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.137991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.149244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.150697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.160785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 969/1957] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:31.171376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 989/1958] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:30 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:31.173056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:31.183335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa9b68-a296-4084-bab1-d2d01b4db22f service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:31.238987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.239600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.239883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.240187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.240831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.242765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.389374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 970/1959] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:31 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:31.390887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:31.401218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4b7f4-f59a-445c-a404-38dd87c39d54 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:31.405881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.406664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.406836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.407556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.407694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.409345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.419853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 990/1960] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:31.424022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:31.434500 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2fce2-484b-4f0b-abee-2e27851068ff admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:31.439397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.440917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.441230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.441478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] PATH_INFO: `/v3/projects/1e3b21f6f6d841dcaa00f0947d64cfc2/users/d32c73abc1f94b2db800990768f802d7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.456339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3b21f6f6d841dcaa00f0947d64cfc2, user_id=d32c73abc1f94b2db800990768f802d7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.459128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.569121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 971/1961] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:31 2022] PUT /identity/v3/projects/1e3b21f6f6d841dcaa00f0947d64cfc2/users/d32c73abc1f94b2db800990768f802d7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:31.573187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:31.583881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f101-d496-42a9-9a09-327127765b68 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:31.626520 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:31.651088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.651627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.651921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.652213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.652862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.654553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.668386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 991/1962] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:31.671812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:31.681984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8ef0a-0f1b-4ac4-a960-1a60aff55e00 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:31.685418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441187a-7e38-478d-9d83-d18e77f7bfaf admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:31.689578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.690944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.691429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.691739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5093b9-75f2-40a6-b930-ff4723932c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:31.691875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.693404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5093b9-75f2-40a6-b930-ff4723932c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.693612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:31.693877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5093b9-75f2-40a6-b930-ff4723932c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.694207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5093b9-75f2-40a6-b930-ff4723932c18 admin admin] PATH_INFO: `/v3/projects/1e3b21f6f6d841dcaa00f0947d64cfc2/users/d32c73abc1f94b2db800990768f802d7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.697283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5093b9-75f2-40a6-b930-ff4723932c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3b21f6f6d841dcaa00f0947d64cfc2, user_id=d32c73abc1f94b2db800990768f802d7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.700006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5093b9-75f2-40a6-b930-ff4723932c18 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.712374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 992/1963] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:31 2022] PUT /identity/v3/projects/1e3b21f6f6d841dcaa00f0947d64cfc2/users/d32c73abc1f94b2db800990768f802d7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:31.723827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fc6e-997a-49d4-9e90-ffe46b859045 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:31.724155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fc6e-997a-49d4-9e90-ffe46b859045 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:31.724431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4fc6e-997a-49d4-9e90-ffe46b859045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:31.754081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1ca4fc6e-997a-49d4-9e90-ffe46b859045 None None] MFA Rules not processed for user `d32c73abc1f94b2db800990768f802d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:31.755339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1ca4fc6e-997a-49d4-9e90-ffe46b859045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:31.756101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:31.757644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:31.767184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 972/1964] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:31.829266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 993/1965] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:31.865364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:31.996823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:32.005858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6611ac-5082-41dc-9f42-def9f6d3da2f service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:32.054549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f979c-1d6c-4571-bf46-8b4f18494f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:32.055160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f979c-1d6c-4571-bf46-8b4f18494f7e service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:32.055465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f979c-1d6c-4571-bf46-8b4f18494f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:32.055738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f979c-1d6c-4571-bf46-8b4f18494f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:32.066544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f979c-1d6c-4571-bf46-8b4f18494f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:32.068015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f979c-1d6c-4571-bf46-8b4f18494f7e service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:32.077582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 973/1966] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:32.325598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4fc6e-997a-49d4-9e90-ffe46b859045 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:32.421949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4fc6e-997a-49d4-9e90-ffe46b859045 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:32.427189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:32.427827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:32.428142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:32.428585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] PATH_INFO: `/v3/users/0fb1777eb60d4ac9b48a8c9ddbdc196f` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:32.429565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb1777eb60d4ac9b48a8c9ddbdc196f)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:32.431559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:32.729850 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb1777eb60d4ac9b48a8c9ddbdc196f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:32.742925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb1777eb60d4ac9b48a8c9ddbdc196f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:32.743631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb1777eb60d4ac9b48a8c9ddbdc196f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:32.863714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb1777eb60d4ac9b48a8c9ddbdc196f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:32.871806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb1777eb60d4ac9b48a8c9ddbdc196f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:32.878826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 994/1967] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:32 2022] DELETE /identity/v3/users/0fb1777eb60d4ac9b48a8c9ddbdc196f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:32.883404 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:32.883858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:32.884024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:32.902523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:32.903731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:32.960465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 974/1968] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:32.970292 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:32.971899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:32.989993 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:33.033566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb4d90-82e8-4826-8c6b-494830231865 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:33.038484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:33.039165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:33.039372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:33.039644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:33.053070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:33.053070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:33.063386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 995/1969] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:33.657061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:33.662988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:33.689659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef3384-4621-465d-b319-2c21c0de2b27 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:33.692922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:33.693920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:33.694401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:33.694828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] PATH_INFO: `/v3/projects/62473d28b9bd4818aecf4710447e5066` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:33.696673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=62473d28b9bd4818aecf4710447e5066)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:33.711512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:33.713228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:33.856520 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62473d28b9bd4818aecf4710447e5066', 'request_id': 'req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:33.863126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62473d28b9bd4818aecf4710447e5066', 'request_id': 'req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:33.985371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62473d28b9bd4818aecf4710447e5066', 'request_id': 'req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:33.998264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] The token cache is being invalidate because project 62473d28b9bd4818aecf4710447e5066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:33.998585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:33.999265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:34.000835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 975/1970] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:33 2022] DELETE /identity/v3/projects/62473d28b9bd4818aecf4710447e5066 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:34.005093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:34.014755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab85fb-5919-4a50-bc41-f02ea9bda823 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:34.071527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:34.072124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:34.072408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:34.072683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] PATH_INFO: `/v3/users/d32c73abc1f94b2db800990768f802d7` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:34.073940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32c73abc1f94b2db800990768f802d7)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:34.076352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:34.319249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32c73abc1f94b2db800990768f802d7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:34.331971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32c73abc1f94b2db800990768f802d7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:34.332844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32c73abc1f94b2db800990768f802d7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:34.482283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32c73abc1f94b2db800990768f802d7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:34.485647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:34.507207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ed67dc62-8e3e-4637-a7aa-befc845f4796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32c73abc1f94b2db800990768f802d7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:34.514347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 996/1971] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:34 2022] DELETE /identity/v3/users/d32c73abc1f94b2db800990768f802d7 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:35.226553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:35.228131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:35.241975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ae04-0f92-4a3d-aa7e-fc787655fc8d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:35.309492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:35.310137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:35.310453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:35.310730 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] PATH_INFO: `/v3/projects/1e3b21f6f6d841dcaa00f0947d64cfc2` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:35.311881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3b21f6f6d841dcaa00f0947d64cfc2)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:35.313873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:35.403142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:35.458155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3b21f6f6d841dcaa00f0947d64cfc2', 'request_id': 'req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:35.464174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3b21f6f6d841dcaa00f0947d64cfc2', 'request_id': 'req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:35.630496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:35.631309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3b21f6f6d841dcaa00f0947d64cfc2', 'request_id': 'req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:35.644172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] The token cache is being invalidate because project 1e3b21f6f6d841dcaa00f0947d64cfc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:35.644471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:35.645130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c7f1e3c7-bae2-41f5-a075-e64bc55fc972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:35.646640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 976/1972] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:35 2022] DELETE /identity/v3/projects/1e3b21f6f6d841dcaa00f0947d64cfc2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:35.651546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c587a-75e0-4d03-8496-a6c9a736cc68 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:35.651837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c587a-75e0-4d03-8496-a6c9a736cc68 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:35.652161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c587a-75e0-4d03-8496-a6c9a736cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:35.671388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f15c587a-75e0-4d03-8496-a6c9a736cc68 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:35.672652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f15c587a-75e0-4d03-8496-a6c9a736cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:35.734887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 997/1973] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:35.743458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4551fa-82ec-4842-ba9a-dd24cc1f65f9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:35.743947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4551fa-82ec-4842-ba9a-dd24cc1f65f9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:35.744061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4551fa-82ec-4842-ba9a-dd24cc1f65f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:35.764075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9c4551fa-82ec-4842-ba9a-dd24cc1f65f9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:35.765299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9c4551fa-82ec-4842-ba9a-dd24cc1f65f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:35.773605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 977/1974] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:35.777937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c587a-75e0-4d03-8496-a6c9a736cc68 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:35.788179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c587a-75e0-4d03-8496-a6c9a736cc68 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:35.793743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:35.794671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:35.794921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:35.795252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:35.796074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:35.796440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:35.798324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:35.816179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 998/1975] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:35.817714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4551fa-82ec-4842-ba9a-dd24cc1f65f9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:35.828626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4551fa-82ec-4842-ba9a-dd24cc1f65f9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:35.841469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:35.842109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:35.842376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:35.842652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:35.843292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:35.845392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:35.976529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 978/1976] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:35 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:35.980451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:35.992302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c159cbe-7e59-45a2-9aeb-61f82d2883c8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:36.054929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:36.055571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:36.056196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:36.056514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:36.057192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:36.059173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:36.265067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 999/1977] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:35 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:36.271036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:36.281286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697ce0f-3ab1-4290-9ef9-b25af9526f1d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:36.286537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:36.287362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:36.288467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:36.289692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:36.290586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:36.292712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:36.307722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 979/1978] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:36.309221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:36.321340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a12bb-7fe7-4eb8-9c1b-9e332398fb3e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:36.326959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea280-6c01-4a4f-bcac-7c2989d2110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:36.327833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea280-6c01-4a4f-bcac-7c2989d2110a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:36.328396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea280-6c01-4a4f-bcac-7c2989d2110a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:36.329019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea280-6c01-4a4f-bcac-7c2989d2110a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:36.330497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea280-6c01-4a4f-bcac-7c2989d2110a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:36.332982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea280-6c01-4a4f-bcac-7c2989d2110a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:36.345141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1000/1979] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:36.350341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:36.361975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae1db5-f577-4b64-ba3c-a4951cc00243 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:36.367943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:36.368903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:36.369298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:36.369642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] PATH_INFO: `/v3/projects/34abba2788e64320bde00d2877751d04/users/1c218d1584b74de892779f1f73c72f3f/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:36.390978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34abba2788e64320bde00d2877751d04, user_id=1c218d1584b74de892779f1f73c72f3f, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:36.394916 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:36.527145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 980/1980] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:36 2022] PUT /identity/v3/projects/34abba2788e64320bde00d2877751d04/users/1c218d1584b74de892779f1f73c72f3f/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:36.532215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1ad12-8d05-4b30-b72b-c06dc76fb013 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:36.532761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1ad12-8d05-4b30-b72b-c06dc76fb013 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:36.532761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1ad12-8d05-4b30-b72b-c06dc76fb013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:36.564787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e8f1ad12-8d05-4b30-b72b-c06dc76fb013 None None] MFA Rules not processed for user `1c218d1584b74de892779f1f73c72f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:36.570941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e8f1ad12-8d05-4b30-b72b-c06dc76fb013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:36.634194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1001/1981] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:36.638830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:36.709130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2c517-2105-4db8-946c-35e4a061df2a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:36.714152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:36.714801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:36.715080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:36.721031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:36.721031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:36.721031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:36.833216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 981/1982] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:36 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:36.837370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1ad12-8d05-4b30-b72b-c06dc76fb013 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:36.850010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1ad12-8d05-4b30-b72b-c06dc76fb013 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:36.915491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:36.916373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:36.916820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:36.917097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:36.917722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:36.919658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:37.042570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1002/1983] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:36 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:37.046848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.057026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d62f7d-8c84-415e-9f77-9e8b8c507f90 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:37.061670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:37.062269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.062548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.062822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.063468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:37.065107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:37.076484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 982/1984] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:37.081781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.092717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1d51-3754-4177-95e9-4413c543661b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:37.098804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:37.104302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.104302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.104302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] PATH_INFO: `/v3/projects/be178fb04a5d42478f730a0bdd9c156c/users/cc98be05222b45df8a3a8f7e23f81a6a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.121900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be178fb04a5d42478f730a0bdd9c156c, user_id=cc98be05222b45df8a3a8f7e23f81a6a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:37.124927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:37.197248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.199120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:37.213849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1003/1985] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:37 2022] PUT /identity/v3/projects/be178fb04a5d42478f730a0bdd9c156c/users/cc98be05222b45df8a3a8f7e23f81a6a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:37.218358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.218675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e679e-5ac3-4724-afff-1c912ccb9877 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:37.299677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b6b1a-716f-4b5e-b9fa-16edf9a9f5c6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:37.302479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:37.303317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.303989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:37.304117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.304117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] PATH_INFO: `/v3/users/89c8f1b22d1240f3ac0b9e7a0409f0be` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.304738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.305212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c8f1b22d1240f3ac0b9e7a0409f0be)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:37.305320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.305753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.307488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:37.308144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:37.311340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:37.336240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1004/1986] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:37.340291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.363486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511abb61-6a36-474b-a1da-e9286c610493 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:37.372200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:37.373250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.373730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.374291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] PATH_INFO: `/v3/projects/be178fb04a5d42478f730a0bdd9c156c/users/cc98be05222b45df8a3a8f7e23f81a6a/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.379402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be178fb04a5d42478f730a0bdd9c156c, user_id=cc98be05222b45df8a3a8f7e23f81a6a, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:37.381072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:37.385653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:37.400322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1005/1987] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:37 2022] PUT /identity/v3/projects/be178fb04a5d42478f730a0bdd9c156c/users/cc98be05222b45df8a3a8f7e23f81a6a/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:37.401499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.403495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:37.494212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a2def-ce36-41dc-a487-2e96bc47b88f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:37.499606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:37.500380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.500730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.501073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] PATH_INFO: `/v3/users/35c58c2c199f4560b1ab7eca663165f2` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.502312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c58c2c199f4560b1ab7eca663165f2)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:37.505066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:37.552205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c8f1b22d1240f3ac0b9e7a0409f0be'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.553145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c8f1b22d1240f3ac0b9e7a0409f0be'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.554107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c8f1b22d1240f3ac0b9e7a0409f0be'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.602240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:37.658829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c8f1b22d1240f3ac0b9e7a0409f0be'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.667092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a0135514-5c38-4fe1-baf5-3d3cec3c967e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c8f1b22d1240f3ac0b9e7a0409f0be'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.684888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 983/1988] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:37 2022] DELETE /identity/v3/users/89c8f1b22d1240f3ac0b9e7a0409f0be => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:37.686475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871815da-b9b3-4ae4-b23a-9f8f0a06eb45 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.686880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871815da-b9b3-4ae4-b23a-9f8f0a06eb45 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.687166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871815da-b9b3-4ae4-b23a-9f8f0a06eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.724484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-871815da-b9b3-4ae4-b23a-9f8f0a06eb45 None None] MFA Rules not processed for user `cc98be05222b45df8a3a8f7e23f81a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:37.726054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-871815da-b9b3-4ae4-b23a-9f8f0a06eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:37.733086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c58c2c199f4560b1ab7eca663165f2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.747643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c58c2c199f4560b1ab7eca663165f2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.748435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c58c2c199f4560b1ab7eca663165f2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.801977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 984/1989] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:37.803822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86101f-a4f6-451e-976d-e295d800b601 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.803822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86101f-a4f6-451e-976d-e295d800b601 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.804017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86101f-a4f6-451e-976d-e295d800b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.823480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9c86101f-a4f6-451e-976d-e295d800b601 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:37.824670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c58c2c199f4560b1ab7eca663165f2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.825132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9c86101f-a4f6-451e-976d-e295d800b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:37.832711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c58c2c199f4560b1ab7eca663165f2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:37.839178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1006/1990] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:37 2022] DELETE /identity/v3/users/35c58c2c199f4560b1ab7eca663165f2 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:37.841378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.843279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:37.887694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 985/1991] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:37.889213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.889547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.889792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.911013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:37.912253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:37.912855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf92ac-e443-487d-a489-90d6de685c20 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:37.916736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:37.917347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:37.917624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:37.917910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:37.919580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:37.975987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 986/1992] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:37.979538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:37.984356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:38.001480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:38.003793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:38.015523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1007/1993] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:38.016314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:38.017821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:38.054150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd67c-6e67-4e02-a71e-26b0e1e9a4d9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:38.058277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:38.058898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:38.059182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:38.059450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:38.070002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:38.071532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:38.082471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 987/1994] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:38.089803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0f2c1-7327-4fea-915d-16f004b33df0 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:38.093580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:38.094239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:38.094518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:38.094785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:38.104397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:38.105845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:38.116954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1008/1995] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:38.549354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:38.625364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:38.626999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:38.643369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005dfa7-b6a8-4060-a221-be89fd6151e8 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:38.648453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:38.649173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:38.649504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:38.649847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] PATH_INFO: `/v3/projects/bc9d62760e234275ae6b640421d2b4ca` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:38.651457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9d62760e234275ae6b640421d2b4ca)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:38.653467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:38.677381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:38.692709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:38.715306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d9b2-c9aa-4786-8001-9bb5fbe03549 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:38.721007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:38.732172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:38.733502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:38.734391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] PATH_INFO: `/v3/projects/455e722621ba4fdbb92eac3118b4be65` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:38.741191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=455e722621ba4fdbb92eac3118b4be65)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:38.743191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:38.793864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9d62760e234275ae6b640421d2b4ca', 'request_id': 'req-dd071c05-961c-4b31-bebe-58edc3641860'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:38.799338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9d62760e234275ae6b640421d2b4ca', 'request_id': 'req-dd071c05-961c-4b31-bebe-58edc3641860'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:38.888479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455e722621ba4fdbb92eac3118b4be65', 'request_id': 'req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:38.894644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455e722621ba4fdbb92eac3118b4be65', 'request_id': 'req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:38.910367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9d62760e234275ae6b640421d2b4ca', 'request_id': 'req-dd071c05-961c-4b31-bebe-58edc3641860'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:38.932678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] The token cache is being invalidate because project bc9d62760e234275ae6b640421d2b4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:38.932981 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:38.933702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:38.935683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 988/1996] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:38 2022] DELETE /identity/v3/projects/bc9d62760e234275ae6b640421d2b4ca => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:38.939530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:38.941557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:39.012603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd071c05-961c-4b31-bebe-58edc3641860 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:39.030777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455e722621ba4fdbb92eac3118b4be65', 'request_id': 'req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.043872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] The token cache is being invalidate because project 455e722621ba4fdbb92eac3118b4be65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:39.044187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.044858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.046496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1009/1997] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:38 2022] DELETE /identity/v3/projects/455e722621ba4fdbb92eac3118b4be65 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:39.051059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:39.052924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:39.079855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:39.080958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:39.081697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:39.082165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] PATH_INFO: `/v3/users/908c51bf3270480c926b81b3eec8a46f` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:39.084099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=908c51bf3270480c926b81b3eec8a46f)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:39.087627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:39.118140 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca5dfe-9121-46ff-a6e6-e7e521b8ff40 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:39.123612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:39.124290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:39.124641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:39.124919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] PATH_INFO: `/v3/users/a5546e2dc75240d193fb786f6254c6d0` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:39.126129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5546e2dc75240d193fb786f6254c6d0)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:39.129060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:39.405283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908c51bf3270480c926b81b3eec8a46f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.405969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908c51bf3270480c926b81b3eec8a46f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.406591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908c51bf3270480c926b81b3eec8a46f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.412390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5546e2dc75240d193fb786f6254c6d0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.427840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5546e2dc75240d193fb786f6254c6d0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.428631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5546e2dc75240d193fb786f6254c6d0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.542917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908c51bf3270480c926b81b3eec8a46f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.551412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908c51bf3270480c926b81b3eec8a46f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.571627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 989/1998] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:38 2022] DELETE /identity/v3/users/908c51bf3270480c926b81b3eec8a46f => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:39.664938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5546e2dc75240d193fb786f6254c6d0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.673669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5546e2dc75240d193fb786f6254c6d0'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:39.680163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1010/1999] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:39 2022] DELETE /identity/v3/users/a5546e2dc75240d193fb786f6254c6d0 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:39.977987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:39.986738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:40.084649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:40.085538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad3a4c-a611-4605-b235-ef4a953efdb3 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:40.086982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:40.172926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:40.272270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:40.272270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:40.272270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] PATH_INFO: `/v3/users/1c218d1584b74de892779f1f73c72f3f` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:40.272270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c218d1584b74de892779f1f73c72f3f)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:40.272270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:40.274286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec1bf2-ef4b-451d-b4c7-f9730242a871 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:40.274286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:40.274286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:40.274286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:40.274818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] PATH_INFO: `/v3/projects/9c2849a3c2ec40aab7c331868be492f9` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:40.274818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2849a3c2ec40aab7c331868be492f9)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:40.274818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:40.940199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:41.067505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c218d1584b74de892779f1f73c72f3f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.068929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c218d1584b74de892779f1f73c72f3f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.069725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c218d1584b74de892779f1f73c72f3f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.072166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2849a3c2ec40aab7c331868be492f9', 'request_id': 'req-1f52e9f8-3a53-46bb-b852-8b43b8610866'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.082552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2849a3c2ec40aab7c331868be492f9', 'request_id': 'req-1f52e9f8-3a53-46bb-b852-8b43b8610866'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.325698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c218d1584b74de892779f1f73c72f3f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.347960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c218d1584b74de892779f1f73c72f3f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.367656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 990/2000] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:39 2022] DELETE /identity/v3/users/1c218d1584b74de892779f1f73c72f3f => generated 0 bytes in 1390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:41.371507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:41.373574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:41.441801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2849a3c2ec40aab7c331868be492f9', 'request_id': 'req-1f52e9f8-3a53-46bb-b852-8b43b8610866'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.444600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641bd79-5937-4080-b3dc-664073575e3d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:41.450376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:41.451423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:41.451755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:41.452027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] PATH_INFO: `/v3/projects/f15f28faf34d4705b223058e3bdf9eed` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:41.454367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15f28faf34d4705b223058e3bdf9eed)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:41.457195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:41.460857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] The token cache is being invalidate because project 9c2849a3c2ec40aab7c331868be492f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:41.461418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.462309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1f52e9f8-3a53-46bb-b852-8b43b8610866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.464375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1011/2001] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:40 2022] DELETE /identity/v3/projects/9c2849a3c2ec40aab7c331868be492f9 => generated 0 bytes in 1380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:41.469355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:41.469872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:41.470492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:41.495552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:41.496832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:41.506379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1012/2002] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:41.507655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:41.509655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:41.536603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf6797-7d27-4867-b6ac-6a28abc9822b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:41.536603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:41.536603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:41.536603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:41.537077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] PATH_INFO: `/v3/users/41ccef96acae4f34b27184463b60c30a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:41.537077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ccef96acae4f34b27184463b60c30a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:41.537077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:41.654249 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15f28faf34d4705b223058e3bdf9eed', 'request_id': 'req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.661264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15f28faf34d4705b223058e3bdf9eed', 'request_id': 'req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.739135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15f28faf34d4705b223058e3bdf9eed', 'request_id': 'req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.752220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] The token cache is being invalidate because project f15f28faf34d4705b223058e3bdf9eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:41.752537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.753314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.754872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 991/2003] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:41 2022] DELETE /identity/v3/projects/f15f28faf34d4705b223058e3bdf9eed => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:41.755706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:41.757055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:41.815065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ccef96acae4f34b27184463b60c30a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.816506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2de48-4faf-42b0-9f39-ce4e1e38ef19 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:41.820179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:41.820881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:41.821062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:41.821340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:41.823103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:41.827667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ccef96acae4f34b27184463b60c30a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.828409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ccef96acae4f34b27184463b60c30a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.895832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:41.897917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:41.900261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ccef96acae4f34b27184463b60c30a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.909861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ccef96acae4f34b27184463b60c30a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:41.910096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 992/2004] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:41.911097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:41.912466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:41.917782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1013/2005] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:41 2022] DELETE /identity/v3/users/41ccef96acae4f34b27184463b60c30a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:41.927575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41974-bf92-44a8-bf8b-f9f56be136f2 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:42.004919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:42.005630 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:42.005985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:42.006371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] PATH_INFO: `/v3/users/c16a12611be648e888c4526af87827dd` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:42.009546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16a12611be648e888c4526af87827dd)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:42.013067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:42.370761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:42.405452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16a12611be648e888c4526af87827dd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:42.406182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16a12611be648e888c4526af87827dd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:42.406800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16a12611be648e888c4526af87827dd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:42.493411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16a12611be648e888c4526af87827dd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:42.503372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16a12611be648e888c4526af87827dd'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:42.507705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:42.510945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:42.541286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5d81c-ffab-4d7b-a4e9-cf0e167add32 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:42.550290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 993/2006] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:41 2022] DELETE /identity/v3/users/c16a12611be648e888c4526af87827dd => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:42.649076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:42.649988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:42.650533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:42.651196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] PATH_INFO: `/v3/projects/34abba2788e64320bde00d2877751d04` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:42.653438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34abba2788e64320bde00d2877751d04)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:42.656255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:42.763408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:42.766005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:42.780310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfc575-9d2c-443d-920f-65b9ab834a01 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:42.786577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:42.787537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:42.787821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:42.788191 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] PATH_INFO: `/v3/projects/6acf9313802b4e73afc3e6f458f6c2d6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:42.790212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6acf9313802b4e73afc3e6f458f6c2d6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:42.792411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:42.866354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34abba2788e64320bde00d2877751d04', 'request_id': 'req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:42.876798 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34abba2788e64320bde00d2877751d04', 'request_id': 'req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.007897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34abba2788e64320bde00d2877751d04', 'request_id': 'req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.025258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] The token cache is being invalidate because project 34abba2788e64320bde00d2877751d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:43.025951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.027589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.033446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1014/2007] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:42 2022] DELETE /identity/v3/projects/34abba2788e64320bde00d2877751d04 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:43.035030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:43.036716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:43.041958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6acf9313802b4e73afc3e6f458f6c2d6', 'request_id': 'req-4665dae6-8578-4056-b831-bd00e4c21011'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.052552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6acf9313802b4e73afc3e6f458f6c2d6', 'request_id': 'req-4665dae6-8578-4056-b831-bd00e4c21011'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.161948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6acf9313802b4e73afc3e6f458f6c2d6', 'request_id': 'req-4665dae6-8578-4056-b831-bd00e4c21011'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.172179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452cd8a-0c9f-47d1-91e0-856a7a0ef366 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:43.180841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] The token cache is being invalidate because project 6acf9313802b4e73afc3e6f458f6c2d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:43.181418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.184340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4665dae6-8578-4056-b831-bd00e4c21011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.189008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 994/2008] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:42 2022] DELETE /identity/v3/projects/6acf9313802b4e73afc3e6f458f6c2d6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:43.197677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475b21-4fc5-4041-8ccf-12ecd96806d6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:43.206612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475b21-4fc5-4041-8ccf-12ecd96806d6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:43.206612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee475b21-4fc5-4041-8ccf-12ecd96806d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:43.240510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ee475b21-4fc5-4041-8ccf-12ecd96806d6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:43.241906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ee475b21-4fc5-4041-8ccf-12ecd96806d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:43.247421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:43.251865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:43.251865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:43.251865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] PATH_INFO: `/v3/users/cc98be05222b45df8a3a8f7e23f81a6a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:43.251865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc98be05222b45df8a3a8f7e23f81a6a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:43.252964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:43.256491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 995/2009] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:43.266579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a90db-b652-4750-9aa8-978f85f8ea2a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:43.267177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a90db-b652-4750-9aa8-978f85f8ea2a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:43.267664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a90db-b652-4750-9aa8-978f85f8ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:43.297575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-893a90db-b652-4750-9aa8-978f85f8ea2a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:43.299424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-893a90db-b652-4750-9aa8-978f85f8ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:43.315885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 996/2010] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:43.318948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a90db-b652-4750-9aa8-978f85f8ea2a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:43.332809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a90db-b652-4750-9aa8-978f85f8ea2a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:43.338874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:43.339805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:43.340013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:43.341233 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:43.342309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:43.342493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:43.344399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:43.363351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 997/2011] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:43.370019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:43.389905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126a18-fe39-454e-93af-3b7703583a27 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:43.397679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:43.398633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:43.399661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:43.400141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:43.400972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:43.403555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:43.603869 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 998/2012] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:43 2022] POST /identity/v3/projects => generated 375 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:43.604787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:43.606507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:43.618494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc98be05222b45df8a3a8f7e23f81a6a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.640121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc98be05222b45df8a3a8f7e23f81a6a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.641713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc98be05222b45df8a3a8f7e23f81a6a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.701645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b18cd-5f2c-4af6-92c0-eb209038bba6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:43.709924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:43.711304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:43.711304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:43.711304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] PATH_INFO: `/v3/projects/dc3268ffed3c435db2c2839bbdbf19b7` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:43.712689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3268ffed3c435db2c2839bbdbf19b7)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:43.714992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:43.756836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc98be05222b45df8a3a8f7e23f81a6a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.765751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc98be05222b45df8a3a8f7e23f81a6a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.776715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1015/2013] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:43 2022] DELETE /identity/v3/users/cc98be05222b45df8a3a8f7e23f81a6a => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:43.782413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:43.785133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:43.870232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3268ffed3c435db2c2839bbdbf19b7', 'request_id': 'req-c9c923cd-0379-4c54-abd3-5da4e03885c5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.871640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:43.884669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3268ffed3c435db2c2839bbdbf19b7', 'request_id': 'req-c9c923cd-0379-4c54-abd3-5da4e03885c5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:43.936168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5e7eb-182c-449b-a57c-dca85cfdb76f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:43.989620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3268ffed3c435db2c2839bbdbf19b7', 'request_id': 'req-c9c923cd-0379-4c54-abd3-5da4e03885c5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.004393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] The token cache is being invalidate because project dc3268ffed3c435db2c2839bbdbf19b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:44.004914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.005745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c9c923cd-0379-4c54-abd3-5da4e03885c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.007947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 999/2014] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:43 2022] DELETE /identity/v3/projects/dc3268ffed3c435db2c2839bbdbf19b7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:44.014632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.015034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.015536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.030519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165aee6-0c0b-4587-a33d-9276d04c3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.031143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165aee6-0c0b-4587-a33d-9276d04c3951 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.031437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165aee6-0c0b-4587-a33d-9276d04c3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.031752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165aee6-0c0b-4587-a33d-9276d04c3951 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.032363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165aee6-0c0b-4587-a33d-9276d04c3951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.035680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165aee6-0c0b-4587-a33d-9276d04c3951 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.074306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:44.076609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.088072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1000/2015] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:44.089270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.091862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.106834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c09b8-1994-4944-8de9-285112ed9cc9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.116329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.116602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.116941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.117282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] PATH_INFO: `/v3/users/e63d07fb4e55489e96e59a5e53a09023` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.118550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63d07fb4e55489e96e59a5e53a09023)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.120646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.205235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1016/2016] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:43 2022] POST /identity/v3/users => generated 288 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:44.205235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.205235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.205235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.254726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:44.256746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.280098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1017/2017] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:44.281807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.283318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.301737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50c611-64ba-4ae6-9b42-bd20b19349c2 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.307731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.308570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.308952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.309442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.314286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.314286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.329641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1018/2018] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:44.330825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.342603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008c2d2-ace0-444c-b460-ef45208cc12a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.348322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.349374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.350037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.350386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.351128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:44.351521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.353392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.371976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1019/2019] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:44.371976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.379870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63d07fb4e55489e96e59a5e53a09023'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.381346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63d07fb4e55489e96e59a5e53a09023'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.381662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f587856-2a58-4225-a4e9-408a147026f4 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.382526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63d07fb4e55489e96e59a5e53a09023'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.387081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.387683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.387998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.388276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.388925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.390541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.403935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1020/2020] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:44.403935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.403935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.416405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04ae3e-7860-4aff-9ed3-6a846ef5c213 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.421081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.421664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.421943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.422216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.422834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.425390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.454719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63d07fb4e55489e96e59a5e53a09023'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.462656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63d07fb4e55489e96e59a5e53a09023'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.481441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1001/2021] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:44 2022] DELETE /identity/v3/users/e63d07fb4e55489e96e59a5e53a09023 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:44.482268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.484682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.554832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ec734-a405-464a-8c82-7bba9a575545 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.560328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1b397-a120-448c-ac4e-6f0c64b125cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.561132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1b397-a120-448c-ac4e-6f0c64b125cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.564600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1b397-a120-448c-ac4e-6f0c64b125cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.564600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1b397-a120-448c-ac4e-6f0c64b125cd admin admin] PATH_INFO: `/v3/projects/820f53cd7a1d4e58986b721d3c331218/users/422c134c578c4a72a5524ef50ede3f07/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.587454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1b397-a120-448c-ac4e-6f0c64b125cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=820f53cd7a1d4e58986b721d3c331218, user_id=422c134c578c4a72a5524ef50ede3f07, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.591328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1b397-a120-448c-ac4e-6f0c64b125cd admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.592323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1021/2022] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:44 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:44.593727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.600240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.701455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179c092-cb49-4fa1-9d86-01a8e83d6035 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.706473 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.707302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.707764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.708079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] PATH_INFO: `/v3/projects/be178fb04a5d42478f730a0bdd9c156c` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.709436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be178fb04a5d42478f730a0bdd9c156c)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.711604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.725457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1002/2023] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:44 2022] PUT /identity/v3/projects/820f53cd7a1d4e58986b721d3c331218/users/422c134c578c4a72a5524ef50ede3f07/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:44.737542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5640-8bdc-4187-9d2a-23c81ea3feb1 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.738019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5640-8bdc-4187-9d2a-23c81ea3feb1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.738491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce5640-8bdc-4187-9d2a-23c81ea3feb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.774021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c2ce5640-8bdc-4187-9d2a-23c81ea3feb1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:44.775870 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c2ce5640-8bdc-4187-9d2a-23c81ea3feb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:44.855849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1003/2024] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:44.857317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5640-8bdc-4187-9d2a-23c81ea3feb1 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:44.869440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce5640-8bdc-4187-9d2a-23c81ea3feb1 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:44.872619 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:44.875653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be178fb04a5d42478f730a0bdd9c156c', 'request_id': 'req-677f4d46-6f2b-4ea0-b637-796d0272738e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.883735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be178fb04a5d42478f730a0bdd9c156c', 'request_id': 'req-677f4d46-6f2b-4ea0-b637-796d0272738e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:44.948417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:44.949086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:44.949363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:44.949640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:44.950272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:44.952279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:44.991174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be178fb04a5d42478f730a0bdd9c156c', 'request_id': 'req-677f4d46-6f2b-4ea0-b637-796d0272738e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:45.009185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] The token cache is being invalidate because project be178fb04a5d42478f730a0bdd9c156c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:45.009575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:45.010804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-677f4d46-6f2b-4ea0-b637-796d0272738e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:45.014450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1022/2025] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:44 2022] DELETE /identity/v3/projects/be178fb04a5d42478f730a0bdd9c156c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:45.015781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51ee5-be03-444f-8a71-b27cafe646bd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.016176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51ee5-be03-444f-8a71-b27cafe646bd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.016788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da51ee5-be03-444f-8a71-b27cafe646bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.071290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1004/2026] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:44 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:45.072117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.074373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-0da51ee5-be03-444f-8a71-b27cafe646bd None None] MFA Rules not processed for user `422c134c578c4a72a5524ef50ede3f07`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:45.075456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.077175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0da51ee5-be03-444f-8a71-b27cafe646bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.217220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1023/2027] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:45.218888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.219301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.219787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.220073 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da41c17-6a9c-49e7-8f25-ac851aa7f710 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.233905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.234541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.234969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.235251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.238535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.246596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:45.248022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.253796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.255468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.257838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1024/2028] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:45.264858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.266889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.276067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1005/2029] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:45.277376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.279555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.297109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12336047-094f-4b62-aca7-7c29372ca203 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.317677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6a3e0-b4a3-4e9d-b19e-5d92416bbcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.318457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a3e0-b4a3-4e9d-b19e-5d92416bbcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.319271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a3e0-b4a3-4e9d-b19e-5d92416bbcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.319806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a3e0-b4a3-4e9d-b19e-5d92416bbcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.320690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a3e0-b4a3-4e9d-b19e-5d92416bbcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.326627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a3e0-b4a3-4e9d-b19e-5d92416bbcc6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.341413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1025/2030] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:45.346578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f80b-d48f-4bee-b7dc-c1b4ca734aa7 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.347181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f80b-d48f-4bee-b7dc-c1b4ca734aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.353107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f80b-d48f-4bee-b7dc-c1b4ca734aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.379701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1148f80b-d48f-4bee-b7dc-c1b4ca734aa7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:45.381319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1148f80b-d48f-4bee-b7dc-c1b4ca734aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.391326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1026/2031] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:45.397009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508c592-dfe4-444c-9885-eb3963a8e21f service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.399576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f80b-d48f-4bee-b7dc-c1b4ca734aa7 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.401513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.402457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.402457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.406352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.412746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.414209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.414734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f80b-d48f-4bee-b7dc-c1b4ca734aa7 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.422854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.423596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.423945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.424250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.424412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1006/2032] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:45.424999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.425470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.426653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.437405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28cd52-d244-48fe-84e0-fc1fc7ea69f6 service glance] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.442176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1027/2033] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:45.442319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.443431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.443553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.443768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.444102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.444812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:45.445126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.447151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.462211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1007/2034] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:45.467727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.472259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc6d86-cbcd-49a1-b71d-1669cd554997 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.477584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcce745-7664-46f6-b010-e841f2cdc778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.479058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce745-7664-46f6-b010-e841f2cdc778 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.479780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce745-7664-46f6-b010-e841f2cdc778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.480122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce745-7664-46f6-b010-e841f2cdc778 admin admin] PATH_INFO: `/v3/projects/a725839e8ac84c4d9bc9f662db868039/users/a6df3afa6a4f4c6c9484a78c8e8cede2/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.485877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a424d-c5bf-48a3-92fe-ee2236fdedbb admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.491804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ad857-65c0-4c39-b348-356f1da3e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.493215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ad857-65c0-4c39-b348-356f1da3e516 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.493671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ad857-65c0-4c39-b348-356f1da3e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.493911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ad857-65c0-4c39-b348-356f1da3e516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.494575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ad857-65c0-4c39-b348-356f1da3e516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.496603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ad857-65c0-4c39-b348-356f1da3e516 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.505277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcce745-7664-46f6-b010-e841f2cdc778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a725839e8ac84c4d9bc9f662db868039, user_id=a6df3afa6a4f4c6c9484a78c8e8cede2, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.508515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcce745-7664-46f6-b010-e841f2cdc778 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.669108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1028/2035] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:45 2022] PUT /identity/v3/projects/a725839e8ac84c4d9bc9f662db868039/users/a6df3afa6a4f4c6c9484a78c8e8cede2/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:45.669813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0859-97f4-4d30-80f9-29cbf9767173 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.670637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0859-97f4-4d30-80f9-29cbf9767173 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.671121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0859-97f4-4d30-80f9-29cbf9767173 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.672790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1029/2036] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:14:45.675133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1008/2037] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:45.675792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0859-97f4-4d30-80f9-29cbf9767173 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.680931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e608f0-f1e8-4ac8-abaf-ed9484159f14 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.681328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e608f0-f1e8-4ac8-abaf-ed9484159f14 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.681696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e608f0-f1e8-4ac8-abaf-ed9484159f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.743409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-91e608f0-f1e8-4ac8-abaf-ed9484159f14 None None] MFA Rules not processed for user `a6df3afa6a4f4c6c9484a78c8e8cede2`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:45.744703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-91e608f0-f1e8-4ac8-abaf-ed9484159f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.789255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0859-97f4-4d30-80f9-29cbf9767173 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.794657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.795342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.795723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.796102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.796811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.798772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.863372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1009/2038] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:45.864709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.865001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.865281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.884856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:45.886062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:45.908313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1030/2039] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:45.911817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.923072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb059a5-a585-4436-8b08-1b12887198dc admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:45.930922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:45.932922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:45.933350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:45.933780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:45.935028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:45.938582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:45.985459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1010/2040] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:45.986712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:45.988390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.006114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f2ab-4683-4c29-9083-6a2ea4b22c3f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.010784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.011414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.011689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.011989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] PATH_INFO: `/v3/projects/0398fa23dddb438aa64d4588aa1cf628` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.013137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0398fa23dddb438aa64d4588aa1cf628)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.015057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.072884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1031/2041] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:45 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:46.073673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.135161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee43e3b-d3ae-4535-9d82-f534baa3a641 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.139925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.140538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.147585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.147585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.147585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.147585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.153565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1032/2042] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:46.154411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.156053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.168579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82df3-76ec-4d93-b89a-1506419fd88f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.173306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:46.176381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.176601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.176930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.177200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] PATH_INFO: `/v3/users/9ab8473b2bcf4a2f80d990ee39aac517` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.178339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab8473b2bcf4a2f80d990ee39aac517)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.184918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.195004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0398fa23dddb438aa64d4588aa1cf628', 'request_id': 'req-b826c25f-3d97-447e-8a01-e734963a20cf'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.202106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0398fa23dddb438aa64d4588aa1cf628', 'request_id': 'req-b826c25f-3d97-447e-8a01-e734963a20cf'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.310161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0398fa23dddb438aa64d4588aa1cf628', 'request_id': 'req-b826c25f-3d97-447e-8a01-e734963a20cf'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.322277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] The token cache is being invalidate because project 0398fa23dddb438aa64d4588aa1cf628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:46.322565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.323206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.328209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1011/2043] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:45 2022] DELETE /identity/v3/projects/0398fa23dddb438aa64d4588aa1cf628 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:46.328209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.328209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.398783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826c25f-3d97-447e-8a01-e734963a20cf admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.404161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.404819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.405099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.405376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.407160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.418597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.420498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.430663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1012/2044] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:46.431450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.432852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.503967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f55adb-6389-420f-b88d-bba65e3c1637 service placement] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.508603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.509208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.509484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.509753 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.510375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.512384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.521483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab8473b2bcf4a2f80d990ee39aac517'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.537625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab8473b2bcf4a2f80d990ee39aac517'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.538344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab8473b2bcf4a2f80d990ee39aac517'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.644397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab8473b2bcf4a2f80d990ee39aac517'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.657956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1013/2045] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:46 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:46.658139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-452dad98-391d-422c-a724-d2a1b377da46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab8473b2bcf4a2f80d990ee39aac517'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:46.658218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.658218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.663810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1033/2046] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:46 2022] DELETE /identity/v3/users/9ab8473b2bcf4a2f80d990ee39aac517 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:46.667165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27172384-ce41-421b-b4b3-f3b57a037b53 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.667165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27172384-ce41-421b-b4b3-f3b57a037b53 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.667165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27172384-ce41-421b-b4b3-f3b57a037b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.674152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9786-4909-4dc1-963e-a201bde3ee06 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.690399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-27172384-ce41-421b-b4b3-f3b57a037b53 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:46.691655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-27172384-ce41-421b-b4b3-f3b57a037b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.739762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.740796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.741082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.741440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.742072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.743695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.757385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1014/2047] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:46.757385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.758647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.770278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1034/2048] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:46.771586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238e19-975c-4b8f-9a88-7055ae0f434a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.772092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27172384-ce41-421b-b4b3-f3b57a037b53 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.783881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fb2d0-7fd1-4256-88ff-37262b7d65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.784620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb2d0-7fd1-4256-88ff-37262b7d65bb admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.784971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb2d0-7fd1-4256-88ff-37262b7d65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.785387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb2d0-7fd1-4256-88ff-37262b7d65bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.785969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27172384-ce41-421b-b4b3-f3b57a037b53 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.786097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fb2d0-7fd1-4256-88ff-37262b7d65bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.788027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fb2d0-7fd1-4256-88ff-37262b7d65bb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.791205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.791867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.792175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.792444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] PATH_INFO: `/v3/projects/43e34f7ac4174d36b4048016117a580c/users/bbe0c12d86e140cf931d457091fd64a3/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.799189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1015/2049] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:46.800701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8d9b-a40f-4aef-9e63-1f6efdf8747d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.800983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8d9b-a40f-4aef-9e63-1f6efdf8747d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.801262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c8d9b-a40f-4aef-9e63-1f6efdf8747d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.810713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e34f7ac4174d36b4048016117a580c, user_id=bbe0c12d86e140cf931d457091fd64a3, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.814008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.824784 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cc3c8d9b-a40f-4aef-9e63-1f6efdf8747d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:46.826001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cc3c8d9b-a40f-4aef-9e63-1f6efdf8747d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:46.836949 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1016/2050] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:46.840787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c8d9b-a40f-4aef-9e63-1f6efdf8747d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.850472 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c8d9b-a40f-4aef-9e63-1f6efdf8747d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.855175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2707c6-fdd2-48b7-8649-163adbfd129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.855985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2707c6-fdd2-48b7-8649-163adbfd129b admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.856204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2707c6-fdd2-48b7-8649-163adbfd129b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.856494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2707c6-fdd2-48b7-8649-163adbfd129b admin admin] PATH_INFO: `/v3/projects/6ed95a4581054c279e0f0eccb0f7cb97/users/456b30bcfda1471894db582ee9b8cb82/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.872691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2707c6-fdd2-48b7-8649-163adbfd129b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed95a4581054c279e0f0eccb0f7cb97, user_id=456b30bcfda1471894db582ee9b8cb82, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.875462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2707c6-fdd2-48b7-8649-163adbfd129b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:46.910949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1035/2051] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:46 2022] PUT /identity/v3/projects/43e34f7ac4174d36b4048016117a580c/users/bbe0c12d86e140cf931d457091fd64a3/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:46.912026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:46.985441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c76371-5e40-441c-9776-a1f92f9b9db3 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:46.990801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:46.991409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:46.991688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:46.992109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:46.992762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:46.993071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:46.994760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.001576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1017/2052] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:46 2022] PUT /identity/v3/projects/6ed95a4581054c279e0f0eccb0f7cb97/users/456b30bcfda1471894db582ee9b8cb82/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:47.003462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72217bc8-40b3-430a-93fc-0fe3575a8146 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.003742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72217bc8-40b3-430a-93fc-0fe3575a8146 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.004033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72217bc8-40b3-430a-93fc-0fe3575a8146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.008446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1036/2053] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:47.009837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.011557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.025433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76ec8-3600-425e-8740-76ae2b58494a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.038433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-72217bc8-40b3-430a-93fc-0fe3575a8146 None None] MFA Rules not processed for user `bbe0c12d86e140cf931d457091fd64a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:47.039885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-72217bc8-40b3-430a-93fc-0fe3575a8146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.078428 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:47.089445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.090087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.090371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.090646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] PATH_INFO: `/v3/projects/ae8fcca5d13a4f648bbadb4d6c0bc236` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.091881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8fcca5d13a4f648bbadb4d6c0bc236)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.094049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.112579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1018/2054] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:47.113658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72217bc8-40b3-430a-93fc-0fe3575a8146 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.125179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72217bc8-40b3-430a-93fc-0fe3575a8146 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.130724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.131330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.131607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.137668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.137668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.137668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.144314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1019/2055] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:47.145084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.154599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26594102-f9a5-41e9-b0e3-729a3c018490 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.159434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.160083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.160368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.160641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.161319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.163168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.217867 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8fcca5d13a4f648bbadb4d6c0bc236', 'request_id': 'req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:47.224354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8fcca5d13a4f648bbadb4d6c0bc236', 'request_id': 'req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:47.310856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8fcca5d13a4f648bbadb4d6c0bc236', 'request_id': 'req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:47.318709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1020/2056] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:47.319875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.323077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] The token cache is being invalidate because project ae8fcca5d13a4f648bbadb4d6c0bc236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:47.323401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:47.324139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:47.325668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1037/2057] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:47 2022] DELETE /identity/v3/projects/ae8fcca5d13a4f648bbadb4d6c0bc236 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:47.326423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.327837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.393825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8790183-07ea-4c6b-ba79-df3fda3d5a3a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.395159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bbb88-ad78-409e-a281-db93681f56fa admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.399124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.400232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.400232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.400480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] PATH_INFO: `/v3/projects/6ed95a4581054c279e0f0eccb0f7cb97/users/456b30bcfda1471894db582ee9b8cb82/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.410116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5739d-c89e-4ee2-8cd2-dcb67576d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.410880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed95a4581054c279e0f0eccb0f7cb97, user_id=456b30bcfda1471894db582ee9b8cb82, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.411019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5739d-c89e-4ee2-8cd2-dcb67576d105 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.411474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5739d-c89e-4ee2-8cd2-dcb67576d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.411777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5739d-c89e-4ee2-8cd2-dcb67576d105 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.412553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5739d-c89e-4ee2-8cd2-dcb67576d105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.413788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.414707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5739d-c89e-4ee2-8cd2-dcb67576d105 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.426115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1038/2058] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:47 2022] PUT /identity/v3/projects/6ed95a4581054c279e0f0eccb0f7cb97/users/456b30bcfda1471894db582ee9b8cb82/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:47.426970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.428946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.498151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c351cf-9f30-4b99-a100-858fba446c12 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.502983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.503613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.504043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.504186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.504821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.506778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.552676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1021/2059] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:47.552676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff765-0356-4a98-8377-41630e524ff2 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.552676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff765-0356-4a98-8377-41630e524ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.552676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dff765-0356-4a98-8377-41630e524ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.571378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b4dff765-0356-4a98-8377-41630e524ff2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:47.574975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b4dff765-0356-4a98-8377-41630e524ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.642890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1022/2060] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:47.644313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ca79-886d-439c-bd99-0562c70c8a3e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.644598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ca79-886d-439c-bd99-0562c70c8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.644873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3ca79-886d-439c-bd99-0562c70c8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.665234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1039/2061] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:47.665234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.665234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.676577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d7443-274a-465c-89b4-7ddb1bab5fea admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.677148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a7e3ca79-886d-439c-bd99-0562c70c8a3e None None] MFA Rules not processed for user `456b30bcfda1471894db582ee9b8cb82`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:47.678532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a7e3ca79-886d-439c-bd99-0562c70c8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.683959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.683959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.683959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.683959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.684373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.685190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.751403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1023/2062] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:47.752934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814411a-544f-4600-994f-d63fa727e917 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.753222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814411a-544f-4600-994f-d63fa727e917 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.753488 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814411a-544f-4600-994f-d63fa727e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.772632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0814411a-544f-4600-994f-d63fa727e917 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:47.773835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0814411a-544f-4600-994f-d63fa727e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.781781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1024/2063] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:47.782692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814411a-544f-4600-994f-d63fa727e917 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.793048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814411a-544f-4600-994f-d63fa727e917 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.798596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.799410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.800287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.800571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.801281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.802904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.814405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1025/2064] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:47.815376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.817173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:47.824942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1040/2065] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:47.825735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.836179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa47fd6-dba1-4d69-828f-4359f32613e8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.841105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.841793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.842157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.842494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.843207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:47.843579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.845225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.858656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1041/2066] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:47.859684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.870340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9ec31-e59c-457b-8ad5-270b1e4c70b1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.876585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.877203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.879070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.879070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.879070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.880230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.884648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57996af4-2a00-4832-b40c-500dfeefe835 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.888413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.889020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.889299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.889572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.890733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1042/2067] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:47.892825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.899795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.901299 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.903537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9a95e-fbf1-4c49-ab5e-141ff1d49a09 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.908435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.909984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.910269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.910547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.911192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.911744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1026/2068] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:47.912592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.912924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.923645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17453d-3d46-447a-b0ad-06bdb6546ec1 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.927824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1043/2069] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:47.927824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:47.934514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.935166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.935623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.935815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.935997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fcbc-9879-4133-9a11-b9eab0fe4b2a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:47.936518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.940602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:47.941599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:47.942266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:47.942563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:47.942845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] PATH_INFO: `/v3/projects/30c4563fc0fa4a00b728c06051880204/users/00607301e5ee4265a3831f192977d4af/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:47.960426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c4563fc0fa4a00b728c06051880204, user_id=00607301e5ee4265a3831f192977d4af, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:47.963197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.124678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1027/2070] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:47 2022] POST /identity/v3/projects => generated 393 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:48.125900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.144989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1044/2071] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:47 2022] PUT /identity/v3/projects/30c4563fc0fa4a00b728c06051880204/users/00607301e5ee4265a3831f192977d4af/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:48.146006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.147714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:48.190247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41fcd2-9e0c-437d-b540-13da131dcfca admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.208067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817cf5b-6098-4aaf-9912-9b636f727dcc admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.211854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.212486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.212763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.213032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.214805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:48.249470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c35d-944b-46d1-b480-fd36f4909e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.250135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c35d-944b-46d1-b480-fd36f4909e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.250413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c35d-944b-46d1-b480-fd36f4909e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.250689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c35d-944b-46d1-b480-fd36f4909e18 admin admin] PATH_INFO: `/v3/projects/0a184607edbd407096740d435be9972a/users/0a1796149af4497d975b49428dde3952/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.270658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c35d-944b-46d1-b480-fd36f4909e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a184607edbd407096740d435be9972a, user_id=0a1796149af4497d975b49428dde3952, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.273457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c35d-944b-46d1-b480-fd36f4909e18 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.277905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.279403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.288507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1045/2072] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:48.291016 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.306562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49897be0-a035-49bf-97ed-696df9f646b4 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.314684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.316401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.316877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.317373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.318254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.320454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.350298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:48.386493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1028/2073] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:48 2022] PUT /identity/v3/projects/0a184607edbd407096740d435be9972a/users/0a1796149af4497d975b49428dde3952/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:48.388930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214e72-6f11-40b3-8c96-50f810bcacee None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.388930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214e72-6f11-40b3-8c96-50f810bcacee None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.388930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3214e72-6f11-40b3-8c96-50f810bcacee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.419415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b3214e72-6f11-40b3-8c96-50f810bcacee None None] MFA Rules not processed for user `00607301e5ee4265a3831f192977d4af`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:48.420985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b3214e72-6f11-40b3-8c96-50f810bcacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:48.429911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1046/2074] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:48 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:48.431380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.446758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d861c8-c768-44d1-9abe-fd83f4eaded0 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.494492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1029/2075] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:48.495372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3214e72-6f11-40b3-8c96-50f810bcacee None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.516158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.516764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.517040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.517309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.518003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.520315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.534147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1047/2076] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:48.534147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.545956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555fa18-7f4d-4ade-a41d-7f03e451b29f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.551151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b9556-abcc-4ccf-893e-cd81bf4e0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.551764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9556-abcc-4ccf-893e-cd81bf4e0d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.552078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9556-abcc-4ccf-893e-cd81bf4e0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.552416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b9556-abcc-4ccf-893e-cd81bf4e0d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.553042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9556-abcc-4ccf-893e-cd81bf4e0d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.555206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b9556-abcc-4ccf-893e-cd81bf4e0d9d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.559892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3214e72-6f11-40b3-8c96-50f810bcacee None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.564638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.565947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.566236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.566518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.567176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.568830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.579131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1030/2077] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:48.580150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.593631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386deac-87d8-494b-b336-cdfdf6189e36 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.598628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.599296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.599568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.599836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] PATH_INFO: `/v3/projects/0a184607edbd407096740d435be9972a/users/0a1796149af4497d975b49428dde3952/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.601787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a184607edbd407096740d435be9972a, user_id=0a1796149af4497d975b49428dde3952, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.604557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.616570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1031/2078] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:48 2022] PUT /identity/v3/projects/0a184607edbd407096740d435be9972a/users/0a1796149af4497d975b49428dde3952/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:48.617458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.686329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9770de-f71c-4cd0-80f4-01559b0765b0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.686329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.686329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.686329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.687166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.687482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.689135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.692430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1048/2079] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:48 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:48.693705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1dd6a-65c0-4b0b-80ed-84d139439a91 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.693989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1dd6a-65c0-4b0b-80ed-84d139439a91 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.694380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1dd6a-65c0-4b0b-80ed-84d139439a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.711516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1032/2080] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:48.711516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.718323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e997c-6568-49e4-9b76-b057ae235c84 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.732448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-65b1dd6a-65c0-4b0b-80ed-84d139439a91 None None] MFA Rules not processed for user `0a1796149af4497d975b49428dde3952`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:48.733703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-65b1dd6a-65c0-4b0b-80ed-84d139439a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:48.778548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.779165 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.779447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.779728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.780396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.782348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.812249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1049/2081] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:48.813181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1dd6a-65c0-4b0b-80ed-84d139439a91 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.824727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1dd6a-65c0-4b0b-80ed-84d139439a91 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:48.829651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:48.830294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:48.830862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:48.831144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] PATH_INFO: `/v3/projects/f40c5b3d8b1f452a94e47d41a75729b0/users/624edd17ef8040538a16bd302851f93f/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:48.845438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40c5b3d8b1f452a94e47d41a75729b0, user_id=624edd17ef8040538a16bd302851f93f, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:48.848139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:48.915502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1033/2082] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:48 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:48.916632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.945622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1050/2083] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:48 2022] PUT /identity/v3/projects/f40c5b3d8b1f452a94e47d41a75729b0/users/624edd17ef8040538a16bd302851f93f/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:48.946232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:48.974246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7dcf-3b10-4f25-a1c4-6dc91bac3039 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.009587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d7517-c504-4fc2-ba03-91dc1804ea2e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.016135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1a4be-41f2-432b-a580-dfa3fe1411e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.017057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a4be-41f2-432b-a580-dfa3fe1411e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.017552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a4be-41f2-432b-a580-dfa3fe1411e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.018163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1a4be-41f2-432b-a580-dfa3fe1411e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.019379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1a4be-41f2-432b-a580-dfa3fe1411e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.021449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1a4be-41f2-432b-a580-dfa3fe1411e1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.026467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.027701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.028197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.028554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.035347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1051/2084] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:49.036712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee8da-3e41-4c70-97f4-6d5b076f7503 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.036997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee8da-3e41-4c70-97f4-6d5b076f7503 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.037279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ee8da-3e41-4c70-97f4-6d5b076f7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.059971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1c4ee8da-3e41-4c70-97f4-6d5b076f7503 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:49.059971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1c4ee8da-3e41-4c70-97f4-6d5b076f7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:49.069232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1052/2085] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:49.073379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee8da-3e41-4c70-97f4-6d5b076f7503 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:49.083365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ee8da-3e41-4c70-97f4-6d5b076f7503 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.088351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.088955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.089231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.089497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.090137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.091772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.099098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.100757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.105554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1053/2086] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:49.105554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:49.105554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:49.114573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1034/2087] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:49.122322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:49.130067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729ad5a-162f-4c31-bd3c-5504d73cf5fe service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.134875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.135541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.135877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.136175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] PATH_INFO: `/v3/projects/0b195384aaf34d9c87dc29b23088e9b3/users/c35d3cb25b88476d98ff7b9c6b6c8fae/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.152262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b195384aaf34d9c87dc29b23088e9b3, user_id=c35d3cb25b88476d98ff7b9c6b6c8fae, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.155135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.161825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:49.167816 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7f35e-34b7-4b35-9fa5-789ab55f27e5 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.171571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91918cb7-652b-453a-9e09-0ac359876046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.172194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91918cb7-652b-453a-9e09-0ac359876046 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.172469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91918cb7-652b-453a-9e09-0ac359876046 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.172736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91918cb7-652b-453a-9e09-0ac359876046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.183705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91918cb7-652b-453a-9e09-0ac359876046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.185365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91918cb7-652b-453a-9e09-0ac359876046 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.196104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1054/2088] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:49.263264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1035/2089] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:49 2022] PUT /identity/v3/projects/0b195384aaf34d9c87dc29b23088e9b3/users/c35d3cb25b88476d98ff7b9c6b6c8fae/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:49.274323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b71dd-5517-4cf2-b00a-a89ff36cdc3c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.274954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b71dd-5517-4cf2-b00a-a89ff36cdc3c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.275465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b71dd-5517-4cf2-b00a-a89ff36cdc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.308906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-960b71dd-5517-4cf2-b00a-a89ff36cdc3c None None] MFA Rules not processed for user `c35d3cb25b88476d98ff7b9c6b6c8fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:49.310110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-960b71dd-5517-4cf2-b00a-a89ff36cdc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:49.392443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1055/2090] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:49.394738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:49.470774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d094-bb74-4c04-adb0-b979d686cf3d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.475917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.476552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.476850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.477120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.477748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.479660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.642489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1036/2091] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:49 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:49.644956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b71dd-5517-4cf2-b00a-a89ff36cdc3c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:49.657217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b71dd-5517-4cf2-b00a-a89ff36cdc3c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.757950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.758683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.759027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.759394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.760143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.762630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.766452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:49.779852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afb936-c424-4d55-9ab4-6bfb557d106b admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.785491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.786169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.786449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.786724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] PATH_INFO: `/v3/users/bbe0c12d86e140cf931d457091fd64a3` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.787926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe0c12d86e140cf931d457091fd64a3)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.789902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.951298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1056/2092] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:49 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:49.956280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:49.966580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ae7e-499e-4461-bbfc-c73d4d552935 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:49.971757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:49.972408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:49.972684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:49.972952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:49.973593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:49.975243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:49.985576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1057/2093] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:49.993932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:50.005381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fca679-757d-4bc8-b1b4-0f978d187b99 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:50.010978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:50.012029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:50.012029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:50.012609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] PATH_INFO: `/v3/projects/fc76d522339c4e5391b1d1b1eecb751e/users/5e8808fb6842493dba1883364b0a6aab/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:50.030199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc76d522339c4e5391b1d1b1eecb751e, user_id=5e8808fb6842493dba1883364b0a6aab, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:50.033114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:50.210565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1058/2094] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:49 2022] PUT /identity/v3/projects/fc76d522339c4e5391b1d1b1eecb751e/users/5e8808fb6842493dba1883364b0a6aab/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:50.214779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:50.222527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe0c12d86e140cf931d457091fd64a3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:50.224106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe0c12d86e140cf931d457091fd64a3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:50.224839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe0c12d86e140cf931d457091fd64a3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:50.293519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df08a7-8582-4193-bd6f-28b45963712f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:50.298509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:50.299736 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:50.300152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:50.300629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:50.301290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:50.302939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:50.314727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1059/2095] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:50.319465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:50.321442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:50.326566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe0c12d86e140cf931d457091fd64a3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:50.332092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-01e41fda-ca24-4c6d-be21-cb6a09c65e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe0c12d86e140cf931d457091fd64a3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:50.339275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a848e92-f47d-4760-92e3-4c97ca75b37e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:50.348934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2ccc9-4c7c-47a0-ad40-4850a30da05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:50.349630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ccc9-4c7c-47a0-ad40-4850a30da05f admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:50.349930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ccc9-4c7c-47a0-ad40-4850a30da05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:50.350215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ccc9-4c7c-47a0-ad40-4850a30da05f admin admin] PATH_INFO: `/v3/projects/fc76d522339c4e5391b1d1b1eecb751e/users/5e8808fb6842493dba1883364b0a6aab/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:50.352328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2ccc9-4c7c-47a0-ad40-4850a30da05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc76d522339c4e5391b1d1b1eecb751e, user_id=5e8808fb6842493dba1883364b0a6aab, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:50.355054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2ccc9-4c7c-47a0-ad40-4850a30da05f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:50.364740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1037/2096] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:49 2022] DELETE /identity/v3/users/bbe0c12d86e140cf931d457091fd64a3 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:50.367685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1060/2097] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:50 2022] PUT /identity/v3/projects/fc76d522339c4e5391b1d1b1eecb751e/users/5e8808fb6842493dba1883364b0a6aab/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:50.369479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:50.370096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:50.370560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:50.379855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613637-105a-4986-81c1-3172643e004f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:50.380531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613637-105a-4986-81c1-3172643e004f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:50.380895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73613637-105a-4986-81c1-3172643e004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:50.395857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:50.397202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:50.416558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-73613637-105a-4986-81c1-3172643e004f None None] MFA Rules not processed for user `5e8808fb6842493dba1883364b0a6aab`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:50.418129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-73613637-105a-4986-81c1-3172643e004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:50.466617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1038/2098] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:50.480991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:50.482434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:50.498231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1061/2099] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:50.510938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73613637-105a-4986-81c1-3172643e004f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:50.512298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-73613637-105a-4986-81c1-3172643e004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:50.555124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e908c-4ad5-47cf-a4ed-b312622aae01 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:50.558901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:50.559516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:50.559799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:50.560104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:50.569972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:50.571445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:50.582242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1039/2100] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:50.589728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73613637-105a-4986-81c1-3172643e004f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:50.593864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:50.594547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:50.594828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:50.595101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:50.597949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:50.666315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:50.667941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:50.677901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1062/2101] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:50.916689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:51.134885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:51.210774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:51.212996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:51.238915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220ebe0-865b-42de-8126-527a6666acf4 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:51.246699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:51.247321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:51.247556 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:51.247827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] PATH_INFO: `/v3/projects/43e34f7ac4174d36b4048016117a580c` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:51.249035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e34f7ac4174d36b4048016117a580c)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:51.250988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:51.419714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e34f7ac4174d36b4048016117a580c', 'request_id': 'req-43342141-a081-44ae-9931-8a0c524db2b0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:51.425762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e34f7ac4174d36b4048016117a580c', 'request_id': 'req-43342141-a081-44ae-9931-8a0c524db2b0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:51.544338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e34f7ac4174d36b4048016117a580c', 'request_id': 'req-43342141-a081-44ae-9931-8a0c524db2b0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:51.565873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] The token cache is being invalidate because project 43e34f7ac4174d36b4048016117a580c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:51.566782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:51.571066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:51.574420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1040/2102] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:51 2022] DELETE /identity/v3/projects/43e34f7ac4174d36b4048016117a580c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:51.578945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:51.585959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:51.587991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:51.603580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352f4e-7ea8-498f-a72f-e3866f349d93 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:51.684951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43342141-a081-44ae-9931-8a0c524db2b0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:51.694516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:51.695248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:51.695590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:51.695945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] PATH_INFO: `/v3/users/a6df3afa6a4f4c6c9484a78c8e8cede2` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:51.697516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6df3afa6a4f4c6c9484a78c8e8cede2)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:51.698824 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:51.699612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:51.703953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:51.704108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:51.704108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] PATH_INFO: `/v3/users/0a1796149af4497d975b49428dde3952` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:51.719668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1796149af4497d975b49428dde3952)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:51.723894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:52.101521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1796149af4497d975b49428dde3952'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.111768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6df3afa6a4f4c6c9484a78c8e8cede2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.115057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6df3afa6a4f4c6c9484a78c8e8cede2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.123037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6df3afa6a4f4c6c9484a78c8e8cede2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.138903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1796149af4497d975b49428dde3952'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.140023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1796149af4497d975b49428dde3952'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.208298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6df3afa6a4f4c6c9484a78c8e8cede2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.220926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-40fe9b46-2c0a-4d3b-96ba-60e7494aaf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6df3afa6a4f4c6c9484a78c8e8cede2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.246929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1041/2103] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:51 2022] DELETE /identity/v3/users/a6df3afa6a4f4c6c9484a78c8e8cede2 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:52.248429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:52.249074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:52.249074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:52.272553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:52.273785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:52.314557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1796149af4497d975b49428dde3952'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.323195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1796149af4497d975b49428dde3952'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:52.333193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1063/2104] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:51 2022] DELETE /identity/v3/users/0a1796149af4497d975b49428dde3952 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:52.336293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1042/2105] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:52.358347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:52.359978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:52.471773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c589a12-1812-4642-a115-832166956bd1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:52.477041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:52.477813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:52.478147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:52.478421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:52.554874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:52.557164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:52.577739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1064/2106] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:52.944581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:52.946298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:52.973449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8010e4d-845a-4002-bfb4-bd0295f1e406 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:52.992840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:52.993454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:52.993988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:52.994263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] PATH_INFO: `/v3/projects/0a184607edbd407096740d435be9972a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:53.000242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a184607edbd407096740d435be9972a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:53.003037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:53.008104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:53.189102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a184607edbd407096740d435be9972a', 'request_id': 'req-14ea827c-f2dd-4fa9-b913-bde3229c2508'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.199655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a184607edbd407096740d435be9972a', 'request_id': 'req-14ea827c-f2dd-4fa9-b913-bde3229c2508'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.221770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:53.221770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:53.304167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a184607edbd407096740d435be9972a', 'request_id': 'req-14ea827c-f2dd-4fa9-b913-bde3229c2508'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.310534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9df02-f9af-4898-8edd-2ac2dec4afe7 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:53.317490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] The token cache is being invalidate because project 0a184607edbd407096740d435be9972a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:53.317786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.318441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.320358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1043/2107] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:52 2022] DELETE /identity/v3/projects/0a184607edbd407096740d435be9972a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:53.321014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:53.322647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:53.395319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d802d-795b-46e5-bc98-e03ea79fa059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:53.395971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d802d-795b-46e5-bc98-e03ea79fa059 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:53.396542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d802d-795b-46e5-bc98-e03ea79fa059 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:53.396968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d802d-795b-46e5-bc98-e03ea79fa059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:53.403425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea827c-f2dd-4fa9-b913-bde3229c2508 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:53.406199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2e0d802d-795b-46e5-bc98-e03ea79fa059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:53.409865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:53.410642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:53.410909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:53.411330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] PATH_INFO: `/v3/users/adfbfd2a39dd4f3ca9c1b3e041088800` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:53.412596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfbfd2a39dd4f3ca9c1b3e041088800)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:53.414659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:53.507662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d802d-795b-46e5-bc98-e03ea79fa059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:53.509383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d802d-795b-46e5-bc98-e03ea79fa059 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:53.526606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1065/2108] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:53.529114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:53.529627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:53.530142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:53.557990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:53.562722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:53.572185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1066/2109] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:53.572185 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:53.575039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:53.589565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28714301-d4ee-4c81-9244-ef4f3e77b481 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:53.595033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:53.595755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:53.596762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:53.597057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] PATH_INFO: `/v3/projects/a725839e8ac84c4d9bc9f662db868039` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:53.598504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a725839e8ac84c4d9bc9f662db868039)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:53.600856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:53.714468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfbfd2a39dd4f3ca9c1b3e041088800'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.714468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfbfd2a39dd4f3ca9c1b3e041088800'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.714468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfbfd2a39dd4f3ca9c1b3e041088800'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.786320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a725839e8ac84c4d9bc9f662db868039', 'request_id': 'req-26384044-8598-470c-a51c-c98f80ea725b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.793476 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a725839e8ac84c4d9bc9f662db868039', 'request_id': 'req-26384044-8598-470c-a51c-c98f80ea725b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.859960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfbfd2a39dd4f3ca9c1b3e041088800'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.872866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-79abec92-8bc9-4702-9b0e-6deb1ab4ba61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfbfd2a39dd4f3ca9c1b3e041088800'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.899819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1044/2110] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:53 2022] DELETE /identity/v3/users/adfbfd2a39dd4f3ca9c1b3e041088800 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:53.901602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:53.903969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:53.904400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:53.930891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:53.932952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:53.933598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a725839e8ac84c4d9bc9f662db868039', 'request_id': 'req-26384044-8598-470c-a51c-c98f80ea725b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.954184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] The token cache is being invalidate because project a725839e8ac84c4d9bc9f662db868039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:53.954540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.956165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-26384044-8598-470c-a51c-c98f80ea725b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:53.973049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1067/2111] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:53 2022] DELETE /identity/v3/projects/a725839e8ac84c4d9bc9f662db868039 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:53.974651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65079-41aa-43b6-bf91-87cdf749f91f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:53.974942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65079-41aa-43b6-bf91-87cdf749f91f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:53.975222 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f65079-41aa-43b6-bf91-87cdf749f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.006323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-90f65079-41aa-43b6-bf91-87cdf749f91f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:54.008198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-90f65079-41aa-43b6-bf91-87cdf749f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:54.051269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1045/2112] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:54.057090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.057090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:54.069830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39149757-94f2-43ff-aa59-e45ca251551a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.075668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.076651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.076956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.077234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] PATH_INFO: `/v3/users/456b30bcfda1471894db582ee9b8cb82` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.078426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456b30bcfda1471894db582ee9b8cb82)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.081652 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.131666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1068/2113] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:54.132904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65079-41aa-43b6-bf91-87cdf749f91f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.146629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f65079-41aa-43b6-bf91-87cdf749f91f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.156322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.156960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.157249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.157525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.158199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:54.159560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.161396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.180763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1069/2114] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:54.180763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.182523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:54.255581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30159-e176-40db-98ad-59c4d5cf3982 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.260054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.260827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.263776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.263776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.273756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.275206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.288676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1070/2115] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:54.289630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.296321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:54.300539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebd015-3b1b-4398-aedf-dea11905614e service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.306915 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.307454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.308233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.315168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.315168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.315168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.458020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1071/2116] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:54 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:54.461998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.466082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456b30bcfda1471894db582ee9b8cb82'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:54.467016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456b30bcfda1471894db582ee9b8cb82'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:54.467945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456b30bcfda1471894db582ee9b8cb82'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:54.552858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1297d-5c57-4fe0-815a-2b9fefaf3357 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.570312 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456b30bcfda1471894db582ee9b8cb82'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:54.575132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.575621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.575920 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.576203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.576964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.579052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.609582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456b30bcfda1471894db582ee9b8cb82'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:54.638506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1046/2117] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:54 2022] DELETE /identity/v3/users/456b30bcfda1471894db582ee9b8cb82 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:54.709624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1072/2118] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:54 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:54.713473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.717052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:54.799843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1c2db-7a41-48c8-b994-3b2c0dc004d5 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.805280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.805892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.806284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.806450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.807064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.808725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.825555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.828648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:54.840558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1047/2119] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:54.848992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.865697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f76b35-6c09-4d1d-a9d9-a2ca75638885 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.888595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f4181-bb99-4163-b890-efea368e3f79 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.892440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.894334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.896475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.897196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] PATH_INFO: `/v3/projects/9dd62e2da02d4e80800b7944ae42f596` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.899053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.899837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.899985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd62e2da02d4e80800b7944ae42f596)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.900408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.900879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:54.901795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:54.904468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.907727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:54.923715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1048/2120] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:54.925867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:54.953363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05278f5-5ed8-47a1-b465-520880ca44a9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:54.990605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58e796-df65-4a57-a181-61e6646e221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:54.991111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58e796-df65-4a57-a181-61e6646e221f admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:54.991563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58e796-df65-4a57-a181-61e6646e221f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:54.992032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58e796-df65-4a57-a181-61e6646e221f admin admin] PATH_INFO: `/v3/projects/259f45ba5fc5405c8741b86182dbf565/users/76a15b9104a14b54ab2123e361d1bf7a/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:55.018775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58e796-df65-4a57-a181-61e6646e221f admin admin] RBAC: Authorizing `identity:create_grant(project_id=259f45ba5fc5405c8741b86182dbf565, user_id=76a15b9104a14b54ab2123e361d1bf7a, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:55.023217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58e796-df65-4a57-a181-61e6646e221f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:55.123812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1049/2121] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:54 2022] PUT /identity/v3/projects/259f45ba5fc5405c8741b86182dbf565/users/76a15b9104a14b54ab2123e361d1bf7a/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:55.128995 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:55.129545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:55.129972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:55.157148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd62e2da02d4e80800b7944ae42f596', 'request_id': 'req-6673c9b2-88be-4080-9e9e-592dfdeca9c2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.174673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd62e2da02d4e80800b7944ae42f596', 'request_id': 'req-6673c9b2-88be-4080-9e9e-592dfdeca9c2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.175799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:55.176996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:55.280113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1050/2122] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:55.281422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:55.284117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:55.300080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd62e2da02d4e80800b7944ae42f596', 'request_id': 'req-6673c9b2-88be-4080-9e9e-592dfdeca9c2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.312668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] The token cache is being invalidate because project 9dd62e2da02d4e80800b7944ae42f596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:55.313047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.315163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.317135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1073/2123] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:54 2022] DELETE /identity/v3/projects/9dd62e2da02d4e80800b7944ae42f596 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:55.321270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:55.322685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:55.339425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673c9b2-88be-4080-9e9e-592dfdeca9c2 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:55.348682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:55.349878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:55.350452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:55.350883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] PATH_INFO: `/v3/users/70c60b49002f4ca0af0860de7ec83282` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:55.352333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c60b49002f4ca0af0860de7ec83282)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:55.355329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:55.383874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678ef80-7022-40ef-982e-f39691209e1d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:55.388883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:55.389601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:55.399279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:55.399279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:55.399279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:55.421260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:55.434291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:55.451947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1051/2124] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:55.453105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:55.454442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:55.481740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24240e5a-790b-44fe-a28a-279bea95b085 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:55.487802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:55.488778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:55.489066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:55.489341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] PATH_INFO: `/v3/projects/6ed95a4581054c279e0f0eccb0f7cb97` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:55.491423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed95a4581054c279e0f0eccb0f7cb97)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:55.493429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:55.598745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c60b49002f4ca0af0860de7ec83282'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.620225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c60b49002f4ca0af0860de7ec83282'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.621012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c60b49002f4ca0af0860de7ec83282'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.641141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed95a4581054c279e0f0eccb0f7cb97', 'request_id': 'req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.648513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed95a4581054c279e0f0eccb0f7cb97', 'request_id': 'req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.756184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c60b49002f4ca0af0860de7ec83282'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.764103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c60b49002f4ca0af0860de7ec83282'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.770521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1074/2125] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:14:55 2022] DELETE /identity/v3/users/70c60b49002f4ca0af0860de7ec83282 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:55.771489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:55.772902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:55.863931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed95a4581054c279e0f0eccb0f7cb97', 'request_id': 'req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.870842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fea28-dd00-48ae-b198-5757c15312f9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:55.875271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:55.875926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:55.876327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:55.876721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:55.894883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] The token cache is being invalidate because project 6ed95a4581054c279e0f0eccb0f7cb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:55.895019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.895702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-44bc73ce-ceb7-43e3-9e7b-ba2801ada98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:55.897217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:55.899959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1052/2126] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:55 2022] DELETE /identity/v3/projects/6ed95a4581054c279e0f0eccb0f7cb97 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:55.905199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5c31f-c97a-4d59-be63-5e37dcdfdfe8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:55.905489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5c31f-c97a-4d59-be63-5e37dcdfdfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:55.906149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5c31f-c97a-4d59-be63-5e37dcdfdfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:55.935248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-bab5c31f-c97a-4d59-be63-5e37dcdfdfe8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:55.936879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-bab5c31f-c97a-4d59-be63-5e37dcdfdfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:56.021172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:56.022935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:56.032649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1053/2127] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:56.035743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1075/2128] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:56.045596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6946c-a733-4b34-b658-450964a11d82 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.045884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6946c-a733-4b34-b658-450964a11d82 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.046204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6946c-a733-4b34-b658-450964a11d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.068332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c3d6946c-a733-4b34-b658-450964a11d82 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:56.069621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c3d6946c-a733-4b34-b658-450964a11d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:56.089944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1054/2129] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:56.091344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:56.092990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:56.107683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e182f7-d75f-4a27-ada0-5a0afafd57a9 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:56.113115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:56.113832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.114067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.114340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.114998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:56.115301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:56.117030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:56.129917 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1076/2130] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:14:56.134298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6946c-a733-4b34-b658-450964a11d82 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:56.159942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6946c-a733-4b34-b658-450964a11d82 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:56.168711 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:56.169408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.169754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.170098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.170806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:56.173291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:56.289193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:56.305888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:56.306971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1055/2131] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:56 2022] POST /identity/v3/projects => generated 399 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:56.323713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828e338-e5b5-4c01-96d6-3ca962faa50b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:56.412949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:56.413725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.414006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.414408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.415197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:56.417335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:56.442848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:56.517768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1077/2132] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:56 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:56.520557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:56.535143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5809bb-c4d4-4d7a-83e3-a75d831da261 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:56.554327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:56.554945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.555230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.555498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.565756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:56.565756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:56.595207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:56.606066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1056/2133] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:56.615209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092be187-421d-4216-b1cc-a537af29ae7d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:56.620827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:56.621599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.622121 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.622665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.623389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:56.626750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:56.642864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1078/2134] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:56.647891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:56.672908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acde5a-53f2-4c3e-b3d4-45808600d3d9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:56.681749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e615da-8fda-45b1-be1c-a0199097abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:56.682226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e615da-8fda-45b1-be1c-a0199097abfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.682563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e615da-8fda-45b1-be1c-a0199097abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.682929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e615da-8fda-45b1-be1c-a0199097abfa admin admin] PATH_INFO: `/v3/projects/542fc6f6c73946338f2b1cfb37c52614/users/4e41d80948b546e79ff42ae370df2e42/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.707260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e615da-8fda-45b1-be1c-a0199097abfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=542fc6f6c73946338f2b1cfb37c52614, user_id=4e41d80948b546e79ff42ae370df2e42, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:56.714259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e615da-8fda-45b1-be1c-a0199097abfa admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:56.820945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:56.832773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1057/2135] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:56 2022] PUT /identity/v3/projects/542fc6f6c73946338f2b1cfb37c52614/users/4e41d80948b546e79ff42ae370df2e42/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:56.840221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:56.846708 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c599b-7e6f-4dcd-9d69-919f6d8dfb4b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:56.846992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c599b-7e6f-4dcd-9d69-919f6d8dfb4b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:56.852283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c599b-7e6f-4dcd-9d69-919f6d8dfb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:56.877782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d126-47d8-4638-997d-da342bbce88a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:56.905328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-fd5c599b-7e6f-4dcd-9d69-919f6d8dfb4b None None] MFA Rules not processed for user `4e41d80948b546e79ff42ae370df2e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:56.908305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fd5c599b-7e6f-4dcd-9d69-919f6d8dfb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.024961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:57.025765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.026053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.026322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] PATH_INFO: `/v3/projects/0873e43db9a94476b8f74afc0aad99ae` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.027644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0873e43db9a94476b8f74afc0aad99ae)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:57.029792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:57.058248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1058/2136] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:14:57.060670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.060670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.060670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.091232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] MFA Rules not processed for user `624edd17ef8040538a16bd302851f93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:57.092549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.154146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0873e43db9a94476b8f74afc0aad99ae', 'request_id': 'req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:57.162181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0873e43db9a94476b8f74afc0aad99ae', 'request_id': 'req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:57.179694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1059/2137] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:57.180869 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:57.182416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.250387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6745-cedf-465e-a9ef-2acd5e21a9da None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:57.292776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0873e43db9a94476b8f74afc0aad99ae', 'request_id': 'req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:57.300399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36900305-17b8-4cf9-bd2c-9328cfb1e940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:57.301019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36900305-17b8-4cf9-bd2c-9328cfb1e940 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.301320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36900305-17b8-4cf9-bd2c-9328cfb1e940 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.301610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36900305-17b8-4cf9-bd2c-9328cfb1e940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.304374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] The token cache is being invalidate because project 0873e43db9a94476b8f74afc0aad99ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:14:57.304674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:57.305296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6fe3de9e-e9de-46a4-9017-c3fd6847e9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:14:57.306786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1079/2138] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:14:56 2022] DELETE /identity/v3/projects/0873e43db9a94476b8f74afc0aad99ae => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:57.308188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.308483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.308883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.333047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] MFA Rules not processed for user `624edd17ef8040538a16bd302851f93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:57.334689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.373555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36900305-17b8-4cf9-bd2c-9328cfb1e940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:57.378740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36900305-17b8-4cf9-bd2c-9328cfb1e940 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:57.415268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1060/2139] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:14:57.418205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827514-729c-48d2-888e-24a9480367dd None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.418397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827514-729c-48d2-888e-24a9480367dd None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.424759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78827514-729c-48d2-888e-24a9480367dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.433389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1080/2140] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:57.450001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:57.452147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-78827514-729c-48d2-888e-24a9480367dd None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:57.452271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.453394 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-78827514-729c-48d2-888e-24a9480367dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.561187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1061/2141] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:57.569087 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcbd1-ad04-414d-bfe0-4f85f2bd839b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.569376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcbd1-ad04-414d-bfe0-4f85f2bd839b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.569654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdcbd1-ad04-414d-bfe0-4f85f2bd839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.599984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f5fdcbd1-ad04-414d-bfe0-4f85f2bd839b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:57.602210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f5fdcbd1-ad04-414d-bfe0-4f85f2bd839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.602805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a27da-af98-48d6-9761-709558ce1a8d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:57.616898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:57.616898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.616898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.616898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.617768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1062/2142] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:57.617937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:57.620100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdcbd1-ad04-414d-bfe0-4f85f2bd839b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:57.633999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:57.635021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdcbd1-ad04-414d-bfe0-4f85f2bd839b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:57.636045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:57.647263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e8091-2b02-49ba-afe3-e8769718f731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:57.647948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8091-2b02-49ba-afe3-e8769718f731 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.648192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8091-2b02-49ba-afe3-e8769718f731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.648497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e8091-2b02-49ba-afe3-e8769718f731 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.649104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e8091-2b02-49ba-afe3-e8769718f731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:14:57.649429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e8091-2b02-49ba-afe3-e8769718f731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:57.650092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1081/2143] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:14:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:14:57.651318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e8091-2b02-49ba-afe3-e8769718f731 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:57.668781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1063/2144] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:14:57.670144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:57.688674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea868ebb-989a-4244-a0fb-99a13e02c6aa service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:57.694141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:57.694765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.695048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.695333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.696028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:57.698051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:57.867017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:57.867740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:57.869196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:57.882151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1082/2145] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:57 2022] POST /identity/v3/projects => generated 391 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:57.887257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:57.931376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] MFA Rules not processed for user `76a15b9104a14b54ab2123e361d1bf7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:57.932728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:58.055729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1064/2146] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:58.061211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.061362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2ba2b-67e5-4985-90cb-d857d72e9f9b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.063067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:58.078922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb0117-dfa1-4486-ba25-40f1b3e3adad None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.079165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.079804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.080694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.081144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.081783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.083990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.087811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.091344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.091344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.091344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.091344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.092358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.225678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1083/2147] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:57 2022] POST /identity/v3/users => generated 296 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:58.230034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.241596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433f3e7-db12-4e6c-a277-cdfc66968fca admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.246900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.247672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.248090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.248457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.249221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.251085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.273159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1084/2148] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:58.273159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.285968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31945ae2-006a-45c5-a0ab-fd3e6f26217d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.291266 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.292399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.292838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.293704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.294586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.296553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.313169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1085/2149] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:58.315477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.321349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1065/2150] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:58 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:58.329899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf03a2-2546-45a9-8ff2-637c11f31bba admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.330715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.444093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943659-a42c-44f7-8b9f-71cd9fbc60f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.445377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943659-a42c-44f7-8b9f-71cd9fbc60f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.445668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943659-a42c-44f7-8b9f-71cd9fbc60f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.445947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943659-a42c-44f7-8b9f-71cd9fbc60f8 admin admin] PATH_INFO: `/v3/projects/4e5db3497d5745428cd8d4f84ebce348/users/38ebae69add04412874c8aac49db88a4/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.469360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943659-a42c-44f7-8b9f-71cd9fbc60f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5db3497d5745428cd8d4f84ebce348, user_id=38ebae69add04412874c8aac49db88a4, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.473107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943659-a42c-44f7-8b9f-71cd9fbc60f8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.496845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde1f3-c029-4854-845a-e69e207408ab admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.504906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.505935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.506134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.506520 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.507330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.509534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.597638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1086/2151] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:58 2022] PUT /identity/v3/projects/4e5db3497d5745428cd8d4f84ebce348/users/38ebae69add04412874c8aac49db88a4/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:58.607608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a2a2-354a-47e9-9d77-a442934c3926 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.607900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a2a2-354a-47e9-9d77-a442934c3926 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.608190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a2a2-354a-47e9-9d77-a442934c3926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.637971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1066/2152] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:58 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:58.641661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.656522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e5150-3140-4533-8911-12c16ddc1f1d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.664648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-4dd5a2a2-354a-47e9-9d77-a442934c3926 None None] MFA Rules not processed for user `38ebae69add04412874c8aac49db88a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:58.664648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4dd5a2a2-354a-47e9-9d77-a442934c3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:58.794206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.794662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.794941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.795348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.795858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.797498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.818716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1087/2153] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:58.822750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0372a6-4334-49a7-96a9-e2b901bb8f49 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.822750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0372a6-4334-49a7-96a9-e2b901bb8f49 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.822750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0372a6-4334-49a7-96a9-e2b901bb8f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.836726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1067/2154] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:58.836726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.850002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aab2b4-3737-421e-8351-7b3c7c1a9ba0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:58.855815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:58.856642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:58.857064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:58.857523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-aa0372a6-4334-49a7-96a9-e2b901bb8f49 None None] MFA Rules not processed for user `624edd17ef8040538a16bd302851f93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:58.858193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:58.858992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:58.860702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-aa0372a6-4334-49a7-96a9-e2b901bb8f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:14:58.862515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:58.952406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1088/2155] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:14:58.953351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0372a6-4334-49a7-96a9-e2b901bb8f49 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.958709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1068/2156] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:14:58 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:14:58.962680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:58.967247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0372a6-4334-49a7-96a9-e2b901bb8f49 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.029379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912a029-22ea-45e4-9eaa-f0c0140a9601 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.035499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.036420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.036846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.038822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.038822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.040481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.067389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.068103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.068388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.068662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] PATH_INFO: `/v3/projects/6fb66e88688047868032b3c21deea2c8/users/9736c6e86e4b47c788a4a9798bf9d4c9/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.085831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb66e88688047868032b3c21deea2c8, user_id=9736c6e86e4b47c788a4a9798bf9d4c9, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.088585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.210146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1089/2157] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:58 2022] PUT /identity/v3/projects/6fb66e88688047868032b3c21deea2c8/users/9736c6e86e4b47c788a4a9798bf9d4c9/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:59.210351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1069/2158] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:14:58 2022] POST /identity/v3/users => generated 303 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:14:59.213199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:59.214539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:59.225546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20052b-2d95-4d8e-a24e-bf7420b36d49 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.280789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750748f5-551c-4873-b334-02fbad47762c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.286533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.287322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.287608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.287885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.288572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.290213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.295371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.296035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.296481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.296957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.297637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.299821 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.307455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1090/2159] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:59.308700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:59.322683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98c2ef-9756-4120-b45c-a7f8111f8863 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.328684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.332851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1070/2160] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:14:59.332994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.332994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.332994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] PATH_INFO: `/v3/projects/6fb66e88688047868032b3c21deea2c8/users/9736c6e86e4b47c788a4a9798bf9d4c9/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.332994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb66e88688047868032b3c21deea2c8, user_id=9736c6e86e4b47c788a4a9798bf9d4c9, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.334011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:59.336010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.346188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:59.351675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1091/2161] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:59 2022] PUT /identity/v3/projects/6fb66e88688047868032b3c21deea2c8/users/9736c6e86e4b47c788a4a9798bf9d4c9/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:14:59.371186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ff57f-8a32-4baa-9d6d-31ccb25037c8 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.484745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.485644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.486122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.486904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] PATH_INFO: `/v3/projects/b47083f3bd0b41958b653d38a00a173a/users/b1465ec62d914efab567608334fa0742/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.522757 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47083f3bd0b41958b653d38a00a173a, user_id=b1465ec62d914efab567608334fa0742, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.525865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.646972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1071/2162] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:59 2022] PUT /identity/v3/projects/b47083f3bd0b41958b653d38a00a173a/users/b1465ec62d914efab567608334fa0742/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:59.648846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:59.665956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9e5a1-260d-435c-abf9-43659a399684 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.765661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7dfb18-a2d1-45b9-a43d-cfeab24d329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.766346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dfb18-a2d1-45b9-a43d-cfeab24d329a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.766624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dfb18-a2d1-45b9-a43d-cfeab24d329a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.767097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7dfb18-a2d1-45b9-a43d-cfeab24d329a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.767843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dfb18-a2d1-45b9-a43d-cfeab24d329a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.769706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7dfb18-a2d1-45b9-a43d-cfeab24d329a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.780167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1092/2163] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:14:59.785099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:14:59.795598 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6514-a767-472f-a0eb-e4c24a29c55b admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:14:59.801291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:14:59.801899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.802185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.802526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] PATH_INFO: `/v3/projects/b47083f3bd0b41958b653d38a00a173a/users/b1465ec62d914efab567608334fa0742/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.804462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47083f3bd0b41958b653d38a00a173a, user_id=b1465ec62d914efab567608334fa0742, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:14:59.807177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:14:59.820940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1072/2164] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:14:59 2022] PUT /identity/v3/projects/b47083f3bd0b41958b653d38a00a173a/users/b1465ec62d914efab567608334fa0742/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:14:59.835015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188e95-3d01-48ec-ab16-4f4cd3f01f8c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:14:59.835708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188e95-3d01-48ec-ab16-4f4cd3f01f8c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:14:59.837699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba188e95-3d01-48ec-ab16-4f4cd3f01f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:14:59.958612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ba188e95-3d01-48ec-ab16-4f4cd3f01f8c None None] MFA Rules not processed for user `b1465ec62d914efab567608334fa0742`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:14:59.980170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ba188e95-3d01-48ec-ab16-4f4cd3f01f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:00.254377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1093/2165] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:14:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:00.318965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:00.320865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:00.388958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2ab43-7073-4e4a-88cb-29d0b976af89 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:00.392771 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a18bc-1d19-4a5a-a76b-fce147a51e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:00.393383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a18bc-1d19-4a5a-a76b-fce147a51e59 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:00.393653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a18bc-1d19-4a5a-a76b-fce147a51e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:00.393964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a18bc-1d19-4a5a-a76b-fce147a51e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:00.403829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a18bc-1d19-4a5a-a76b-fce147a51e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:00.406002 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a18bc-1d19-4a5a-a76b-fce147a51e59 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:00.418127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1073/2166] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:00 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:00.495684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:00.524750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba188e95-3d01-48ec-ab16-4f4cd3f01f8c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:00.542176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba188e95-3d01-48ec-ab16-4f4cd3f01f8c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:00.546049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae185bb5-658d-4cf5-9c54-32816b77c073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:00.546691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185bb5-658d-4cf5-9c54-32816b77c073 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:00.546985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185bb5-658d-4cf5-9c54-32816b77c073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:00.547258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185bb5-658d-4cf5-9c54-32816b77c073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:00.640785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae185bb5-658d-4cf5-9c54-32816b77c073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:00.642297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae185bb5-658d-4cf5-9c54-32816b77c073 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:00.663015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1094/2167] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:01.791146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:01.792169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:01.792596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:01.841795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] MFA Rules not processed for user `9736c6e86e4b47c788a4a9798bf9d4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:01.843190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:01.951739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1074/2168] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:01.966244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:01.966716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:01.966716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:02.005492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] MFA Rules not processed for user `76a15b9104a14b54ab2123e361d1bf7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:02.010764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:02.093677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1095/2169] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:02.111163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:02.111163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:02.228227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f5f8-a2c6-40c4-b056-b51497ea93bb None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:02.237379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8dcb8-9c6a-4593-a673-69a555ba82b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:02.238333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8dcb8-9c6a-4593-a673-69a555ba82b5 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:02.238686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8dcb8-9c6a-4593-a673-69a555ba82b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:02.239260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8dcb8-9c6a-4593-a673-69a555ba82b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:02.253217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8dcb8-9c6a-4593-a673-69a555ba82b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:02.255236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8dcb8-9c6a-4593-a673-69a555ba82b5 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:02.284481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1075/2170] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:02.412459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:02.414019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:02.509460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc766f-f675-485c-8f2b-32a3573cff0d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:02.514809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:02.515097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:02.515386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:02.515655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] PATH_INFO: `/v3/users/00607301e5ee4265a3831f192977d4af` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:02.516842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00607301e5ee4265a3831f192977d4af)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:02.519674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:02.676462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:02.756927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00607301e5ee4265a3831f192977d4af'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:02.792010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00607301e5ee4265a3831f192977d4af'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:02.792770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00607301e5ee4265a3831f192977d4af'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:02.915302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00607301e5ee4265a3831f192977d4af'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:02.923424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00607301e5ee4265a3831f192977d4af'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:02.929787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1096/2171] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:02 2022] DELETE /identity/v3/users/00607301e5ee4265a3831f192977d4af => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:02.934462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:02.934950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:02.935044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:02.978440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:02.979685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:03.103035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1076/2172] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:03.131518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:03.134703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:03.271267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27164d-f48a-4d66-ae42-48fb12291410 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:03.281421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:03.281421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:03.281421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:03.281421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:03.296659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:03.300047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:03.316754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1097/2173] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:03.659783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:03.821608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:03.824016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:03.849388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b7e5-e99e-4f22-aba0-a4b69cb5324b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:03.855068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:03.855748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:03.856074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:03.856349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] PATH_INFO: `/v3/users/422c134c578c4a72a5524ef50ede3f07` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:03.860298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=422c134c578c4a72a5524ef50ede3f07)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:03.874248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:03.944293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:03.946267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:03.984435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127592-86c3-43b2-81fe-9022e9935a03 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:03.997882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:03.998570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:03.998944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:03.999388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] PATH_INFO: `/v3/projects/30c4563fc0fa4a00b728c06051880204` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:04.003789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c4563fc0fa4a00b728c06051880204)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:04.006575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:04.372653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422c134c578c4a72a5524ef50ede3f07'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.375550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422c134c578c4a72a5524ef50ede3f07'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.376314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422c134c578c4a72a5524ef50ede3f07'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.401715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c4563fc0fa4a00b728c06051880204', 'request_id': 'req-4dbc7595-5181-4c73-9a5a-9427d911de6f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.411717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c4563fc0fa4a00b728c06051880204', 'request_id': 'req-4dbc7595-5181-4c73-9a5a-9427d911de6f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.500223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422c134c578c4a72a5524ef50ede3f07'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.510446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3544af39-8712-4bd6-9d8e-5540a8265d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422c134c578c4a72a5524ef50ede3f07'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.539152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1077/2174] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:03 2022] DELETE /identity/v3/users/422c134c578c4a72a5524ef50ede3f07 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:04.543173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:04.543581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:04.544005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:04.567293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:04.568866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:04.613742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c4563fc0fa4a00b728c06051880204', 'request_id': 'req-4dbc7595-5181-4c73-9a5a-9427d911de6f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.626406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] The token cache is being invalidate because project 30c4563fc0fa4a00b728c06051880204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:04.626809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.627474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:04.629247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1098/2175] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:03 2022] DELETE /identity/v3/projects/30c4563fc0fa4a00b728c06051880204 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:04.633735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:04.638631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:04.667451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1078/2176] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:04.675954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:04.680444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:04.772047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc7595-5181-4c73-9a5a-9427d911de6f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:04.793389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:04.794074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:04.796509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:04.798122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] PATH_INFO: `/v3/users/c35d3cb25b88476d98ff7b9c6b6c8fae` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:04.799800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35d3cb25b88476d98ff7b9c6b6c8fae)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:04.802229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:04.803694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63357bf7-83f8-40e8-b8fc-c17a774efe04 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:04.809028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:04.811063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:04.812203 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:04.812632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:04.833490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:04.835214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:04.847198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1079/2177] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:15:04.848151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:04.849524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:04.863121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16e46-c946-48ce-992f-1576cb7e5d51 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:04.869592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:04.870233 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:04.870684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:04.871134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] PATH_INFO: `/v3/users/4e41d80948b546e79ff42ae370df2e42` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:04.872375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e41d80948b546e79ff42ae370df2e42)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:04.874577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:05.025721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35d3cb25b88476d98ff7b9c6b6c8fae'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.046062 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35d3cb25b88476d98ff7b9c6b6c8fae'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.046953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35d3cb25b88476d98ff7b9c6b6c8fae'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.177820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:05.178628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35d3cb25b88476d98ff7b9c6b6c8fae'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.189834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-255f8db7-6576-46e1-9288-36d76916e046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35d3cb25b88476d98ff7b9c6b6c8fae'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.196335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1099/2178] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:04 2022] DELETE /identity/v3/users/c35d3cb25b88476d98ff7b9c6b6c8fae => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:05.205156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e41d80948b546e79ff42ae370df2e42'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.206080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e41d80948b546e79ff42ae370df2e42'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.206845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e41d80948b546e79ff42ae370df2e42'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.423152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e41d80948b546e79ff42ae370df2e42'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.438030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e41d80948b546e79ff42ae370df2e42'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.471323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1080/2179] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:04 2022] DELETE /identity/v3/users/4e41d80948b546e79ff42ae370df2e42 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:05.476055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:05.476538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:05.476616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:05.500073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:05.502160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:05.568360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1100/2180] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:05.578156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:05.589825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:05.664146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6824ae-8eaf-43b8-8c7d-85e65192fe1c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:05.675129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:05.675939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:05.676462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:05.676818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:05.698072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:05.699554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:05.708951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:05.710396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:05.718156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1081/2181] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:05.725927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a72c7-63b7-4795-9c7f-9a61f7f11c06 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:05.731058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:05.731702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:05.732084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:05.732717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] PATH_INFO: `/v3/projects/820f53cd7a1d4e58986b721d3c331218` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:05.733927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820f53cd7a1d4e58986b721d3c331218)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:05.738202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:05.883624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820f53cd7a1d4e58986b721d3c331218', 'request_id': 'req-4db3d6dc-2a99-45b2-b7a6-297304cc3493'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.890335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820f53cd7a1d4e58986b721d3c331218', 'request_id': 'req-4db3d6dc-2a99-45b2-b7a6-297304cc3493'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:05.906374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:05.908786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:05.936451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58722361-1476-43f7-bc6e-3f5320b7a4be service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:06.013280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:06.013914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.014188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.014456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] PATH_INFO: `/v3/projects/0b195384aaf34d9c87dc29b23088e9b3` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.015588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b195384aaf34d9c87dc29b23088e9b3)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:06.018149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:06.018958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820f53cd7a1d4e58986b721d3c331218', 'request_id': 'req-4db3d6dc-2a99-45b2-b7a6-297304cc3493'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.030045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] The token cache is being invalidate because project 820f53cd7a1d4e58986b721d3c331218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:06.030333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.031014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4db3d6dc-2a99-45b2-b7a6-297304cc3493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.038134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1101/2182] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:05 2022] DELETE /identity/v3/projects/820f53cd7a1d4e58986b721d3c331218 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:06.039542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d61b3-416e-4013-a0a8-eda07ae7b51b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.042790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d61b3-416e-4013-a0a8-eda07ae7b51b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.043116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d61b3-416e-4013-a0a8-eda07ae7b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.062847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-286d61b3-416e-4013-a0a8-eda07ae7b51b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:06.064180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-286d61b3-416e-4013-a0a8-eda07ae7b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:06.072360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1102/2183] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:06.080782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917bdf-1737-4e91-ba8a-8a2516b55774 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.081069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917bdf-1737-4e91-ba8a-8a2516b55774 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.081349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1917bdf-1737-4e91-ba8a-8a2516b55774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.104993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a1917bdf-1737-4e91-ba8a-8a2516b55774 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:06.106217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a1917bdf-1737-4e91-ba8a-8a2516b55774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:06.115379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1103/2184] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:06.119290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1917bdf-1737-4e91-ba8a-8a2516b55774 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:06.129470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1917bdf-1737-4e91-ba8a-8a2516b55774 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:06.150554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b195384aaf34d9c87dc29b23088e9b3', 'request_id': 'req-3f378493-f817-4f12-8f5c-473bca89fb01'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.156146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b195384aaf34d9c87dc29b23088e9b3', 'request_id': 'req-3f378493-f817-4f12-8f5c-473bca89fb01'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.193301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:06.194455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.194455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.194695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.195807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:06.196213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:06.197788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:06.213366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1104/2185] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:15:06.217644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:06.231532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f1b15-2239-420e-bf10-064725f0da11 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:06.235676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b195384aaf34d9c87dc29b23088e9b3', 'request_id': 'req-3f378493-f817-4f12-8f5c-473bca89fb01'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.238668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:06.239700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.240028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.240460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.241342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:06.243274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:06.253901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] The token cache is being invalidate because project 0b195384aaf34d9c87dc29b23088e9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:06.254207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.254866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.256633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1082/2186] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:05 2022] DELETE /identity/v3/projects/0b195384aaf34d9c87dc29b23088e9b3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:06.260842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:06.262360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:06.277038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f378493-f817-4f12-8f5c-473bca89fb01 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:06.282059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:06.284135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.284135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.284135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] PATH_INFO: `/v3/users/5e8808fb6842493dba1883364b0a6aab` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.284483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8808fb6842493dba1883364b0a6aab)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:06.286458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:06.505506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1105/2187] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:06 2022] POST /identity/v3/projects => generated 389 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:06.507105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:06.509951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:06.577640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fadc3b-181b-4441-b67b-3f834642570c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:06.582970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:06.583602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.583881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.584219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] PATH_INFO: `/v3/projects/542fc6f6c73946338f2b1cfb37c52614` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.585351 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542fc6f6c73946338f2b1cfb37c52614)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:06.587279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:06.656881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8808fb6842493dba1883364b0a6aab'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.657697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8808fb6842493dba1883364b0a6aab'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.658359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8808fb6842493dba1883364b0a6aab'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.812058 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542fc6f6c73946338f2b1cfb37c52614', 'request_id': 'req-a526751c-0afc-4751-973b-1bd94abfb808'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.819111 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542fc6f6c73946338f2b1cfb37c52614', 'request_id': 'req-a526751c-0afc-4751-973b-1bd94abfb808'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.828155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8808fb6842493dba1883364b0a6aab'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.835271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8808fb6842493dba1883364b0a6aab'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.851975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1083/2188] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:06 2022] DELETE /identity/v3/users/5e8808fb6842493dba1883364b0a6aab => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:06.852739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:06.854043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:06.918559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5ad50-23d1-49e6-8ed8-eb272f75ac9c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:06.923107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:06.924319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:06.924600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:06.924875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:06.925479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:06.927412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:06.932827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542fc6f6c73946338f2b1cfb37c52614', 'request_id': 'req-a526751c-0afc-4751-973b-1bd94abfb808'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.947422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] The token cache is being invalidate because project 542fc6f6c73946338f2b1cfb37c52614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:06.947806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.948572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:06.950197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1106/2189] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:06 2022] DELETE /identity/v3/projects/542fc6f6c73946338f2b1cfb37c52614 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:06.965301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:06.966970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.037465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1084/2190] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:06 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:07.040774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:07.043928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.067582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2330c-ab76-4815-a327-8904de638118 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:07.074694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:07.075682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.076198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.076679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.077881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:07.081533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:07.094877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526751c-0afc-4751-973b-1bd94abfb808 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:07.098283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1085/2191] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:15:07.102941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:07.112447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:07.114186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.114699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.116250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] PATH_INFO: `/v3/users/38ebae69add04412874c8aac49db88a4` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.118119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ebae69add04412874c8aac49db88a4)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:07.123093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:07.127745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b529b7-94b3-4500-a05e-353169b3e4cf admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:07.143876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:07.144685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.145062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.145435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.146223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:07.150447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:07.166240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1086/2192] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:07.169882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:07.181236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4acc51-a1fd-4daa-ae8c-d281009a2d67 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:07.186461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792c408-f080-4fe0-a306-c0dab05e2ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:07.187282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c408-f080-4fe0-a306-c0dab05e2ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.187611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c408-f080-4fe0-a306-c0dab05e2ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.187931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792c408-f080-4fe0-a306-c0dab05e2ddd admin admin] PATH_INFO: `/v3/projects/0cc5cefd24fd427581d286b552cf25ca/users/1b8dd33dc9b644d980d5110167e2b003/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.204309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792c408-f080-4fe0-a306-c0dab05e2ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc5cefd24fd427581d286b552cf25ca, user_id=1b8dd33dc9b644d980d5110167e2b003, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:07.207296 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792c408-f080-4fe0-a306-c0dab05e2ddd admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:07.276402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1087/2193] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:07 2022] PUT /identity/v3/projects/0cc5cefd24fd427581d286b552cf25ca/users/1b8dd33dc9b644d980d5110167e2b003/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:07.287761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.288070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.288348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.318301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] MFA Rules not processed for user `1b8dd33dc9b644d980d5110167e2b003`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:07.319431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.389564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ebae69add04412874c8aac49db88a4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:07.406591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ebae69add04412874c8aac49db88a4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:07.407556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ebae69add04412874c8aac49db88a4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:07.425443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:07.449364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1088/2194] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:07.462928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:07.472433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.521759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ebae69add04412874c8aac49db88a4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:07.541471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-74d2c6f7-53e6-4d34-adc8-c6dc0c707922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ebae69add04412874c8aac49db88a4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:07.551726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1107/2195] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:06 2022] DELETE /identity/v3/users/38ebae69add04412874c8aac49db88a4 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:07.556500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.556915 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.557200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.557618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5319916-bd0b-45e6-8668-d032be34753f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:07.582271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:07.583835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.601719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:07.620141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:07.621060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.621342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.621613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.623948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.711533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1108/2196] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:07.712176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:07.713768 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:07.725251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:07.727403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.730332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1089/2197] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:15:07.817757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e790-3986-4f66-8897-f7b76e04648f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:07.827298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5b9fd-fb15-4838-8024-f549507a426f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:07.834855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b9fd-fb15-4838-8024-f549507a426f service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.834855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b9fd-fb15-4838-8024-f549507a426f service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.834855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5b9fd-fb15-4838-8024-f549507a426f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.847955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b9fd-fb15-4838-8024-f549507a426f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:07.849594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5b9fd-fb15-4838-8024-f549507a426f service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:07.866040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1109/2198] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:15:07.926761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:07.928243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:07.950255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330332e-520a-4fba-a0f4-92104ca684ec service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:07.957441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:07.958262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:07.958527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:07.958875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] PATH_INFO: `/v3/projects/fc76d522339c4e5391b1d1b1eecb751e` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:07.960279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc76d522339c4e5391b1d1b1eecb751e)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:07.963183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:08.120796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc76d522339c4e5391b1d1b1eecb751e', 'request_id': 'req-5be795c8-8549-4970-a8ed-2c2e4af8dce0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.126071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc76d522339c4e5391b1d1b1eecb751e', 'request_id': 'req-5be795c8-8549-4970-a8ed-2c2e4af8dce0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.258670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc76d522339c4e5391b1d1b1eecb751e', 'request_id': 'req-5be795c8-8549-4970-a8ed-2c2e4af8dce0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.274418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] The token cache is being invalidate because project fc76d522339c4e5391b1d1b1eecb751e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:08.274732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.275412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-5be795c8-8549-4970-a8ed-2c2e4af8dce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.277242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1090/2199] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:07 2022] DELETE /identity/v3/projects/fc76d522339c4e5391b1d1b1eecb751e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:08.282114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56291a1-2103-46cc-90a8-04d94bb3cacd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:08.282409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56291a1-2103-46cc-90a8-04d94bb3cacd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:08.282671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56291a1-2103-46cc-90a8-04d94bb3cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:08.304775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a56291a1-2103-46cc-90a8-04d94bb3cacd None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:08.306126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a56291a1-2103-46cc-90a8-04d94bb3cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:08.379516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:08.381133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1110/2200] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:08.393809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94629-a5bf-434d-a40a-513798c7169a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:08.394108 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94629-a5bf-434d-a40a-513798c7169a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:08.394465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94629-a5bf-434d-a40a-513798c7169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:08.414014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a0a94629-a5bf-434d-a40a-513798c7169a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:08.415242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a0a94629-a5bf-434d-a40a-513798c7169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:08.425195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1091/2201] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:08.435427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56291a1-2103-46cc-90a8-04d94bb3cacd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:08.446540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56291a1-2103-46cc-90a8-04d94bb3cacd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:08.451453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:08.452255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:08.452542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:08.452866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:08.453525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:08.453829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:08.455634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:08.473420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1111/2202] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:15:08.474511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94629-a5bf-434d-a40a-513798c7169a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:08.485008 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94629-a5bf-434d-a40a-513798c7169a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:08.493818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:08.499403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:08.499403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:08.499403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:08.499403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:08.499403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:08.524964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:08.527030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:08.546483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de23365-0d7f-4952-9c1d-02807e641fa6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:08.558486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:08.559316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:08.559735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:08.560128 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] PATH_INFO: `/v3/projects/4e5db3497d5745428cd8d4f84ebce348` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:08.561676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5db3497d5745428cd8d4f84ebce348)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:08.564264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:08.632166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1092/2203] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:08 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:15:08.632166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:08.719319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc248-eea9-4381-aa02-451a81b7b1c5 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:08.728738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:08.730548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:08.731309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:08.731589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:08.732279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:08.736228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:08.771992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5db3497d5745428cd8d4f84ebce348', 'request_id': 'req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.780453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5db3497d5745428cd8d4f84ebce348', 'request_id': 'req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.906515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5db3497d5745428cd8d4f84ebce348', 'request_id': 'req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.921102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1093/2204] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:08 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:08.954344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:08.954522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] The token cache is being invalidate because project 4e5db3497d5745428cd8d4f84ebce348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:08.954522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.954522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:08.954522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1112/2205] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:08 2022] DELETE /identity/v3/projects/4e5db3497d5745428cd8d4f84ebce348 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:08.955419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b295b2-0eb6-4d72-8f34-a10043d4f979 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:08.957663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:08.959086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:09.011147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:09.011796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:09.012102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:09.012376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:09.013027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:09.014679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:09.028258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1094/2206] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:09.028426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbe3e1-97df-4a97-bbd3-021dd3eb5b16 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:09.029356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:09.031126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:09.033530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:09.034177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:09.034448 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:09.034729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] PATH_INFO: `/v3/users/b1465ec62d914efab567608334fa0742` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:09.035875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1465ec62d914efab567608334fa0742)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:09.037902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:09.044646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcae678-e3f6-4981-88cc-4a2684f41dc3 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:09.050323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:09.050994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:09.051283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:09.051565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:09.052264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:09.053936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:09.070683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1095/2207] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:09.080468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:09.087329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a757d-04b0-42dc-bafe-31bbb9210649 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:09.092972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efa3ba-101c-4285-9980-2fea010ccf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:09.093654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa3ba-101c-4285-9980-2fea010ccf2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:09.093936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa3ba-101c-4285-9980-2fea010ccf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:09.094215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa3ba-101c-4285-9980-2fea010ccf2a admin admin] PATH_INFO: `/v3/projects/a63bbd7be4cf4e05a5dbc16a4834d800/users/718dfe116af148159c5e9561bacfd4bc/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:09.108525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:09.114315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efa3ba-101c-4285-9980-2fea010ccf2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63bbd7be4cf4e05a5dbc16a4834d800, user_id=718dfe116af148159c5e9561bacfd4bc, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:09.115116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efa3ba-101c-4285-9980-2fea010ccf2a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:09.261038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1096/2208] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:09 2022] PUT /identity/v3/projects/a63bbd7be4cf4e05a5dbc16a4834d800/users/718dfe116af148159c5e9561bacfd4bc/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:09.272242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:09.272585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:09.273229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:09.302637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] MFA Rules not processed for user `718dfe116af148159c5e9561bacfd4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:09.304837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:09.383286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1465ec62d914efab567608334fa0742'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:09.390262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1097/2209] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:09.403015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:09.404975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:09.409927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1465ec62d914efab567608334fa0742'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:09.410724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1465ec62d914efab567608334fa0742'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:09.478559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7f741-8ecc-4c16-b524-72cc45932c0a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:09.482271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:09.482884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:09.483161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:09.483433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:09.492967 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:09.494420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:09.504023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1098/2210] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:09.521637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1465ec62d914efab567608334fa0742'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:09.529615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b70b4506-a096-4aa7-9e8a-ba2d246634a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1465ec62d914efab567608334fa0742'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:09.539611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1113/2211] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:08 2022] DELETE /identity/v3/users/b1465ec62d914efab567608334fa0742 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:10.169951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:10.346443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:10.443010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3e21-072f-4dd1-9d77-252dfc6e9579 service glance] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:10.504817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:10.505456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:10.505739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:10.506014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] PATH_INFO: `/v3/projects/b47083f3bd0b41958b653d38a00a173a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:10.507136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47083f3bd0b41958b653d38a00a173a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:10.509139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:10.633932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47083f3bd0b41958b653d38a00a173a', 'request_id': 'req-dede01ca-70a1-4995-8fe6-0791db3dcaf8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:10.640131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47083f3bd0b41958b653d38a00a173a', 'request_id': 'req-dede01ca-70a1-4995-8fe6-0791db3dcaf8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:10.787716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47083f3bd0b41958b653d38a00a173a', 'request_id': 'req-dede01ca-70a1-4995-8fe6-0791db3dcaf8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:10.801873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] The token cache is being invalidate because project b47083f3bd0b41958b653d38a00a173a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:10.802397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:10.803079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-dede01ca-70a1-4995-8fe6-0791db3dcaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:10.805050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1099/2212] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:10 2022] DELETE /identity/v3/projects/b47083f3bd0b41958b653d38a00a173a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:10.810153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a67c-2aa1-4183-a289-b5d664d9d971 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:10.810685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a67c-2aa1-4183-a289-b5d664d9d971 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:10.810685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a67c-2aa1-4183-a289-b5d664d9d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:10.835617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8d31a67c-2aa1-4183-a289-b5d664d9d971 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:10.837383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8d31a67c-2aa1-4183-a289-b5d664d9d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:10.929747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1114/2213] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:10.938147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f3a2-d954-47dc-84b3-d915541ad344 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:10.938518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f3a2-d954-47dc-84b3-d915541ad344 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:10.939833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f3a2-d954-47dc-84b3-d915541ad344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:10.962274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0819f3a2-d954-47dc-84b3-d915541ad344 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:10.963591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0819f3a2-d954-47dc-84b3-d915541ad344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:10.973017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1100/2214] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:10.977156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31a67c-2aa1-4183-a289-b5d664d9d971 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:10.988054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31a67c-2aa1-4183-a289-b5d664d9d971 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:10.992903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:10.993542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:10.993845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:10.994328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:10.994994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:10.995306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:10.996979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:11.014402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1115/2215] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:15:11.021210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f3a2-d954-47dc-84b3-d915541ad344 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:11.032169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f3a2-d954-47dc-84b3-d915541ad344 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:11.038543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:11.039467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:11.039848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:11.040436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:11.041206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:11.043263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:11.135709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1101/2216] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:11 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:11.137037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:11.154029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c747d-0384-4b0e-ac91-b85a03b1b9d2 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:11.157544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:11.221267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:11.222175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:11.222809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:11.223080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:11.223900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:11.226022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:11.814286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1116/2217] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:11 2022] POST /identity/v3/users => generated 295 bytes in 678 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:15:11.818464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:11.832554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8f26e-27ef-4629-a4cc-fe0f0baa3cc6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:11.838155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:11.838765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:11.839177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:11.839571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:11.840342 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:11.842294 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:11.853973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1102/2218] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:11.858223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:11.869253 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda72ced-1d4b-49cd-880f-d661473489b1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:11.874182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3c913-7498-4423-87bf-cc779607815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:11.874808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3c913-7498-4423-87bf-cc779607815e admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:11.875065 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3c913-7498-4423-87bf-cc779607815e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:11.875337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3c913-7498-4423-87bf-cc779607815e admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:11.876027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3c913-7498-4423-87bf-cc779607815e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:11.877678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3c913-7498-4423-87bf-cc779607815e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:11.890073 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1117/2219] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:11.894925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:11.905662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604112c4-9645-4441-936d-7a04ce0b537d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:11.910833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:11.915965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:11.915965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:11.915965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] PATH_INFO: `/v3/projects/2870f9042a7a474dac944d3f013e4102/users/0bcf96311d394fb4ab63b6e942c97b81/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:11.926467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2870f9042a7a474dac944d3f013e4102, user_id=0bcf96311d394fb4ab63b6e942c97b81, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:11.929158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:12.087820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1103/2220] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:11 2022] PUT /identity/v3/projects/2870f9042a7a474dac944d3f013e4102/users/0bcf96311d394fb4ab63b6e942c97b81/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:12.100194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050797-ae6c-4bea-82a9-48ce569fd826 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:12.100620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050797-ae6c-4bea-82a9-48ce569fd826 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:12.100901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050797-ae6c-4bea-82a9-48ce569fd826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:12.129838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-50050797-ae6c-4bea-82a9-48ce569fd826 None None] MFA Rules not processed for user `0bcf96311d394fb4ab63b6e942c97b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:12.143645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-50050797-ae6c-4bea-82a9-48ce569fd826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:12.266142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1118/2221] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:12.272043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:12.338896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014a01-8094-4a39-b1b9-d4fb98e8f191 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:12.349922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:12.350715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:12.350833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:12.351155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:12.352080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:12.354334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:12.510244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1104/2222] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:12 2022] POST /identity/v3/projects => generated 389 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:12.515559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050797-ae6c-4bea-82a9-48ce569fd826 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:12.532909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050797-ae6c-4bea-82a9-48ce569fd826 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:12.612657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:12.613285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:12.613572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:12.613844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:12.614475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:12.616661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:12.807617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1119/2223] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:12 2022] POST /identity/v3/users => generated 301 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:12.821190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:12.832368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a5044-685f-4319-ab4f-a417186509a4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:12.837040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:12.837648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:12.837928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:12.838204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:12.838855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:12.840549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:12.852335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1105/2224] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:12.867399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:12.878645 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefceb9f-7030-4a05-ae4d-12cf2a71d22e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:12.883449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:12.884230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:12.884631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:12.884912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] PATH_INFO: `/v3/projects/8dcf71adaaf440cc81ab8b32559faf56/users/7d99e054ab8040b0b58281fd485d46c7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:12.905043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcf71adaaf440cc81ab8b32559faf56, user_id=7d99e054ab8040b0b58281fd485d46c7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:12.910240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:13.042213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1120/2225] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:12 2022] PUT /identity/v3/projects/8dcf71adaaf440cc81ab8b32559faf56/users/7d99e054ab8040b0b58281fd485d46c7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:13.046497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:13.057681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c2be4-2d17-4523-83db-9afb945df50c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:13.114554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ad572-7461-439c-ac48-3e50ed309033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:13.115190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ad572-7461-439c-ac48-3e50ed309033 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:13.115479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ad572-7461-439c-ac48-3e50ed309033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:13.115754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ad572-7461-439c-ac48-3e50ed309033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:13.116441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ad572-7461-439c-ac48-3e50ed309033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:13.118216 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ad572-7461-439c-ac48-3e50ed309033 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:13.129046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1106/2226] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:13.133333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:13.144510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf00e5d-0e56-4683-a0b1-e0ff2a7caa41 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:13.149825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:13.150500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:13.150781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:13.152201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] PATH_INFO: `/v3/projects/8dcf71adaaf440cc81ab8b32559faf56/users/7d99e054ab8040b0b58281fd485d46c7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:13.154555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcf71adaaf440cc81ab8b32559faf56, user_id=7d99e054ab8040b0b58281fd485d46c7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:13.157442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:13.168846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1121/2227] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:13 2022] PUT /identity/v3/projects/8dcf71adaaf440cc81ab8b32559faf56/users/7d99e054ab8040b0b58281fd485d46c7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:13.181664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046141ec-3b9c-44be-81fb-d645aa542d79 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:13.182013 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046141ec-3b9c-44be-81fb-d645aa542d79 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:13.182344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046141ec-3b9c-44be-81fb-d645aa542d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:13.214946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-046141ec-3b9c-44be-81fb-d645aa542d79 None None] MFA Rules not processed for user `7d99e054ab8040b0b58281fd485d46c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:13.221090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-046141ec-3b9c-44be-81fb-d645aa542d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:13.296566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1107/2228] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:13.307862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:13.309650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:13.380520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305f7d2-142d-45b7-b359-0d20fd90fd06 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:13.384267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decac8c-76a0-4b62-b717-4f13eacd0ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:13.384868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decac8c-76a0-4b62-b717-4f13eacd0ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:13.385144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decac8c-76a0-4b62-b717-4f13eacd0ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:13.385526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decac8c-76a0-4b62-b717-4f13eacd0ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:13.395683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decac8c-76a0-4b62-b717-4f13eacd0ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:13.397161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decac8c-76a0-4b62-b717-4f13eacd0ff8 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:13.407593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1122/2229] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:13.598670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046141ec-3b9c-44be-81fb-d645aa542d79 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:13.727675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046141ec-3b9c-44be-81fb-d645aa542d79 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:13.737365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:13.738300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:13.738720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:13.739205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] PATH_INFO: `/v3/users/0bcf96311d394fb4ab63b6e942c97b81` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:13.740865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bcf96311d394fb4ab63b6e942c97b81)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:13.743143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:13.946978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bcf96311d394fb4ab63b6e942c97b81'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:13.947703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bcf96311d394fb4ab63b6e942c97b81'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:13.948505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bcf96311d394fb4ab63b6e942c97b81'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:14.074506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bcf96311d394fb4ab63b6e942c97b81'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:14.092578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bcf96311d394fb4ab63b6e942c97b81'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:14.115417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1108/2230] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:13 2022] DELETE /identity/v3/users/0bcf96311d394fb4ab63b6e942c97b81 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:14.120277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:14.121151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:14.121593 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:14.145672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:14.148517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:14.232921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1123/2231] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:14.244442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:14.246041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:14.307889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde3e91-7a78-4e32-8f79-50fdbef49635 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:14.311879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:14.313185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:14.313461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:14.313732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:14.324179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:14.325684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:14.340529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1109/2232] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:14.815252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:14.818203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:14.838475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8934a4-cdc2-4d37-8fdb-71b1a688c679 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:14.851515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:14.851515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:14.851515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:14.851515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] PATH_INFO: `/v3/projects/2870f9042a7a474dac944d3f013e4102` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:14.851993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2870f9042a7a474dac944d3f013e4102)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:14.852265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:14.906412 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:15.052260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2870f9042a7a474dac944d3f013e4102', 'request_id': 'req-f4c922e3-5b7d-4c56-a9af-adc38318b319'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.053691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:15.063268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2870f9042a7a474dac944d3f013e4102', 'request_id': 'req-f4c922e3-5b7d-4c56-a9af-adc38318b319'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.180569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2870f9042a7a474dac944d3f013e4102', 'request_id': 'req-f4c922e3-5b7d-4c56-a9af-adc38318b319'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.192424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] The token cache is being invalidate because project 2870f9042a7a474dac944d3f013e4102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:15.192597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.193359 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.195134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1124/2233] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:14 2022] DELETE /identity/v3/projects/2870f9042a7a474dac944d3f013e4102 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:15.199158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:15.209274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af2bbd-34f5-4c24-a133-fd415b99ad16 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:15.314848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:15.315593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:15.315877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:15.316188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] PATH_INFO: `/v3/users/7d99e054ab8040b0b58281fd485d46c7` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:15.317469 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d99e054ab8040b0b58281fd485d46c7)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:15.319752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:15.546684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d99e054ab8040b0b58281fd485d46c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.547634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d99e054ab8040b0b58281fd485d46c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.549124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d99e054ab8040b0b58281fd485d46c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.632641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d99e054ab8040b0b58281fd485d46c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.641009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0fcfd272-cbb3-4cb1-a90b-6363172b9c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d99e054ab8040b0b58281fd485d46c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:15.658778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1110/2234] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:15 2022] DELETE /identity/v3/users/7d99e054ab8040b0b58281fd485d46c7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:16.135122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:16.136635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:16.156582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c922e3-5b7d-4c56-a9af-adc38318b319 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:16.218021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:16.218668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:16.218853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:16.219127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] PATH_INFO: `/v3/projects/8dcf71adaaf440cc81ab8b32559faf56` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:16.220439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcf71adaaf440cc81ab8b32559faf56)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:16.226098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:16.357823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcf71adaaf440cc81ab8b32559faf56', 'request_id': 'req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:16.365165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcf71adaaf440cc81ab8b32559faf56', 'request_id': 'req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:16.493507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcf71adaaf440cc81ab8b32559faf56', 'request_id': 'req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:16.505668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] The token cache is being invalidate because project 8dcf71adaaf440cc81ab8b32559faf56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:16.506126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:16.506856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a86c4f18-92de-4878-9f4c-1b9273d7f9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:16.511862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1125/2235] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:16 2022] DELETE /identity/v3/projects/8dcf71adaaf440cc81ab8b32559faf56 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:16.513628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9acb-bee5-44b3-93ff-e08a268295a1 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:16.514065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9acb-bee5-44b3-93ff-e08a268295a1 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:16.514261 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9acb-bee5-44b3-93ff-e08a268295a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:16.543548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f0bb9acb-bee5-44b3-93ff-e08a268295a1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:16.544811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f0bb9acb-bee5-44b3-93ff-e08a268295a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:16.617590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1111/2236] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:16.625327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46cf5-3eed-44e5-ab7c-89d02a8e322f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:16.625621 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46cf5-3eed-44e5-ab7c-89d02a8e322f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:16.625969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46cf5-3eed-44e5-ab7c-89d02a8e322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:16.655179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-dba46cf5-3eed-44e5-ab7c-89d02a8e322f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:16.656496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-dba46cf5-3eed-44e5-ab7c-89d02a8e322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:16.665414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1126/2237] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:16.669694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9acb-bee5-44b3-93ff-e08a268295a1 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:16.684042 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9acb-bee5-44b3-93ff-e08a268295a1 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:16.688244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:16.688949 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:16.690566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:16.690566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:16.690566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:16.690566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:16.692239 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:16.708179 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1112/2238] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:15:16.710089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46cf5-3eed-44e5-ab7c-89d02a8e322f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:16.720982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46cf5-3eed-44e5-ab7c-89d02a8e322f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:16.725642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:16.733239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:16.733239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:16.733239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:16.733239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:16.733239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:16.832422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1127/2239] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:16 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:16.836343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:16.846537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b46d9-74ab-4de8-ae24-9526d737e2b7 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:16.908223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:16.908838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:16.909124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:16.909400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:16.910038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:16.912003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:17.060957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1113/2240] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:16 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:17.062612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:17.086367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348427c-c2d9-411f-94bd-2e63012b9009 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:17.098843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:17.099663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.101556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.101556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:17.101994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:17.104549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:17.124433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1128/2241] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:15:17.126032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:17.144939 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c1c4b-cb8e-4fd4-8e49-b3c9e9b22439 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:17.161774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12440daf-0fd4-47ec-8751-078a72cc800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:17.162709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12440daf-0fd4-47ec-8751-078a72cc800e admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.163204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12440daf-0fd4-47ec-8751-078a72cc800e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.163729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12440daf-0fd4-47ec-8751-078a72cc800e admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:17.164620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12440daf-0fd4-47ec-8751-078a72cc800e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:17.167624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12440daf-0fd4-47ec-8751-078a72cc800e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:17.192078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1114/2242] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:17.192229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:17.205423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1e704-ee25-4a03-aa0e-b0b8f6a49d74 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:17.222430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:17.222430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.222430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.222430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] PATH_INFO: `/v3/projects/53e2f7827c1546b7bf60193018c205ac/users/cec519d04b70408db4a99c1267fbb2c7/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:17.235153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e2f7827c1546b7bf60193018c205ac, user_id=cec519d04b70408db4a99c1267fbb2c7, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:17.239203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:17.381883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1129/2243] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:17 2022] PUT /identity/v3/projects/53e2f7827c1546b7bf60193018c205ac/users/cec519d04b70408db4a99c1267fbb2c7/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:17.394092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fd41-569e-4aef-8727-a9bbab81a8db None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.394505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fd41-569e-4aef-8727-a9bbab81a8db None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.394845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283fd41-569e-4aef-8727-a9bbab81a8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:17.431003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3283fd41-569e-4aef-8727-a9bbab81a8db None None] MFA Rules not processed for user `cec519d04b70408db4a99c1267fbb2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:17.431834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3283fd41-569e-4aef-8727-a9bbab81a8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:17.519750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1115/2244] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:17.521154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:17.594845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619a76-2289-40a1-bf28-19e9f2d9523c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:17.601027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:17.601808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.602120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.602391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:17.603025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:17.605059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:17.752195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1130/2245] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:17 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:17.756213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283fd41-569e-4aef-8727-a9bbab81a8db None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:17.768308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283fd41-569e-4aef-8727-a9bbab81a8db None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:17.830176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:17.830831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.833536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.833536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:17.833536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:17.834372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:17.928513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1116/2246] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:17 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:17.932706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:17.943137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2536-4144-4f11-976e-62a3877f0d1c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:17.947732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:17.948432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.948711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.948986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:17.949624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:17.951232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:17.964619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1131/2247] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:17.975534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:17.987440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37082a8-7555-4fd2-8c73-693134d5db13 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:17.992453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:17.993305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:17.993579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:17.993851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] PATH_INFO: `/v3/projects/ae11e2b287e44c81a6d8f4981ffc2307/users/4c6f0f638615428980cee28a357c66f5/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:18.010139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae11e2b287e44c81a6d8f4981ffc2307, user_id=4c6f0f638615428980cee28a357c66f5, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:18.012951 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:18.128035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1117/2248] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:17 2022] PUT /identity/v3/projects/ae11e2b287e44c81a6d8f4981ffc2307/users/4c6f0f638615428980cee28a357c66f5/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:18.132682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:18.146064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738e52-d1b3-4da0-af66-886f4b92cf5d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:18.209030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3df11d-0ebe-427a-bf0f-b79b60e07283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:18.209640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df11d-0ebe-427a-bf0f-b79b60e07283 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:18.209914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df11d-0ebe-427a-bf0f-b79b60e07283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:18.210183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3df11d-0ebe-427a-bf0f-b79b60e07283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:18.211103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3df11d-0ebe-427a-bf0f-b79b60e07283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:18.212742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3df11d-0ebe-427a-bf0f-b79b60e07283 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:18.223855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1132/2249] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:18.228527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:18.241900 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e7155-bc30-406e-82c2-96f008273be2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:18.247046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:18.247875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:18.248202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:18.248471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] PATH_INFO: `/v3/projects/ae11e2b287e44c81a6d8f4981ffc2307/users/4c6f0f638615428980cee28a357c66f5/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:18.250705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae11e2b287e44c81a6d8f4981ffc2307, user_id=4c6f0f638615428980cee28a357c66f5, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:18.253992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:18.268625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1118/2250] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:18 2022] PUT /identity/v3/projects/ae11e2b287e44c81a6d8f4981ffc2307/users/4c6f0f638615428980cee28a357c66f5/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:18.279039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:18.279330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:18.287755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:18.314903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] MFA Rules not processed for user `4c6f0f638615428980cee28a357c66f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:18.316502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:18.402825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1133/2251] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:18.415596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:18.421070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:18.490600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71def0-f153-4544-98e9-44e93bf18dca admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:18.494411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:18.495023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:18.495301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:18.495573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:18.507519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:18.509061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:18.519512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1119/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:18.697139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:18.704066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:18.730773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e968c20-c66e-469c-9e3a-882b69a0649c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:18.734699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257300b-b622-4f98-9d29-10c2a0bb3008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:18.736041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257300b-b622-4f98-9d29-10c2a0bb3008 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:18.736312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257300b-b622-4f98-9d29-10c2a0bb3008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:18.736965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257300b-b622-4f98-9d29-10c2a0bb3008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:18.810316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257300b-b622-4f98-9d29-10c2a0bb3008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:18.811779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257300b-b622-4f98-9d29-10c2a0bb3008 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:18.823159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1134/2253] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:19.417631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:19.489713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b5189-03c6-46a4-9ae9-ad136ac3a33b service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:19.494421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:19.495059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:19.495336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:19.495606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] PATH_INFO: `/v3/users/cec519d04b70408db4a99c1267fbb2c7` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:19.496807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec519d04b70408db4a99c1267fbb2c7)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:19.498781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:19.752055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:19.761074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec519d04b70408db4a99c1267fbb2c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:19.761670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec519d04b70408db4a99c1267fbb2c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:19.762362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec519d04b70408db4a99c1267fbb2c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:19.885524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec519d04b70408db4a99c1267fbb2c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:19.894920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec519d04b70408db4a99c1267fbb2c7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:19.918482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1120/2254] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:19 2022] DELETE /identity/v3/users/cec519d04b70408db4a99c1267fbb2c7 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:19.921167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:19.923338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:19.923777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:19.924115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:19.944439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:19.946113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:20.008634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1135/2255] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:20.020255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:20.021775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:20.088526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a22c26-5c53-4194-aa82-82016819ba98 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:20.092506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:20.094235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:20.094235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:20.094235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:20.104628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:20.106289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:20.118823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1121/2256] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:20.651738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:20.655471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:20.679147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaccce-ea1f-443c-b4da-4a14d0e1ffa1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:20.688110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:20.690554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:20.690916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:20.691237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] PATH_INFO: `/v3/users/1b8dd33dc9b644d980d5110167e2b003` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:20.692781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8dd33dc9b644d980d5110167e2b003)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:20.698913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:20.958650 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:20.968275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:20.974466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6f331-f81d-4f7a-8124-ba7aadc575ae service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:20.979563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:20.980274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:20.980720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:20.981178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] PATH_INFO: `/v3/projects/53e2f7827c1546b7bf60193018c205ac` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:20.982327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e2f7827c1546b7bf60193018c205ac)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:20.984308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:21.008808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8dd33dc9b644d980d5110167e2b003'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.023632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8dd33dc9b644d980d5110167e2b003'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.024977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8dd33dc9b644d980d5110167e2b003'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.118168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8dd33dc9b644d980d5110167e2b003'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.129327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7cc9c64c-d0ae-4397-96be-6ac5774c3a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8dd33dc9b644d980d5110167e2b003'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.134570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e2f7827c1546b7bf60193018c205ac', 'request_id': 'req-b6d7aa01-43a0-4894-879d-4361311fb680'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.137014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1136/2257] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:20 2022] DELETE /identity/v3/users/1b8dd33dc9b644d980d5110167e2b003 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:21.144221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e2f7827c1546b7bf60193018c205ac', 'request_id': 'req-b6d7aa01-43a0-4894-879d-4361311fb680'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.157559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:21.158131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:21.158564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:21.195371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:21.197325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:21.266546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1137/2258] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:21.276467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:21.277835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:21.293550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e2f7827c1546b7bf60193018c205ac', 'request_id': 'req-b6d7aa01-43a0-4894-879d-4361311fb680'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.308808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] The token cache is being invalidate because project 53e2f7827c1546b7bf60193018c205ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:21.308903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.309640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.315086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1122/2259] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:20 2022] DELETE /identity/v3/projects/53e2f7827c1546b7bf60193018c205ac => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:21.316314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:21.318001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:21.358429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa2ec2-bfdb-4aa7-b038-690993acd820 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:21.364600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508da1-c6ee-41e2-aedd-43cb1495769c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:21.365280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508da1-c6ee-41e2-aedd-43cb1495769c service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:21.365557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508da1-c6ee-41e2-aedd-43cb1495769c service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:21.365982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508da1-c6ee-41e2-aedd-43cb1495769c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:21.368101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e1508da1-c6ee-41e2-aedd-43cb1495769c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:21.384450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1508da1-c6ee-41e2-aedd-43cb1495769c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:21.385913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1508da1-c6ee-41e2-aedd-43cb1495769c service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:21.396754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1138/2260] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:15:21.405867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7aa01-43a0-4894-879d-4361311fb680 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:21.411293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:21.411952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:21.412231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:21.412529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] PATH_INFO: `/v3/users/4c6f0f638615428980cee28a357c66f5` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:21.413809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6f0f638615428980cee28a357c66f5)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:21.415779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:21.685831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:21.686517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:21.686517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:21.708339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6f0f638615428980cee28a357c66f5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.709052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] MFA Rules not processed for user `e8776ca5fe264cee904f8fab1a16a5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:21.709565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6f0f638615428980cee28a357c66f5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.710255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:21.711340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6f0f638615428980cee28a357c66f5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.771483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1139/2261] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:21.840876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6f0f638615428980cee28a357c66f5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.849467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-af9f1c76-c838-4ee3-aad5-e3735eef10ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6f0f638615428980cee28a357c66f5'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:21.868582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1123/2262] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:21 2022] DELETE /identity/v3/users/4c6f0f638615428980cee28a357c66f5 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:21.888820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:21.890275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:21.911792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be4982-a768-4f25-9075-b3619dcd1b12 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:21.995977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:21.996922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:21.997308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:21.997711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] PATH_INFO: `/v3/projects/0cc5cefd24fd427581d286b552cf25ca` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.000258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc5cefd24fd427581d286b552cf25ca)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.002950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:22.206095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc5cefd24fd427581d286b552cf25ca', 'request_id': 'req-56c73eb9-9aa5-4842-b424-de4ab7ca699e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.235730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc5cefd24fd427581d286b552cf25ca', 'request_id': 'req-56c73eb9-9aa5-4842-b424-de4ab7ca699e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.321276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc5cefd24fd427581d286b552cf25ca', 'request_id': 'req-56c73eb9-9aa5-4842-b424-de4ab7ca699e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.334868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] The token cache is being invalidate because project 0cc5cefd24fd427581d286b552cf25ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:22.335544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.336409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-56c73eb9-9aa5-4842-b424-de4ab7ca699e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.346426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1140/2263] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:21 2022] DELETE /identity/v3/projects/0cc5cefd24fd427581d286b552cf25ca => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:22.346511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15510-245a-4319-9875-a4d257980b55 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.346511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15510-245a-4319-9875-a4d257980b55 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.346511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15510-245a-4319-9875-a4d257980b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.368198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:22.370466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-13d15510-245a-4319-9875-a4d257980b55 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:22.371873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-13d15510-245a-4319-9875-a4d257980b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:22.435663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1124/2264] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:22.444090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44731465-3bd3-432b-8def-71b166a7ff1e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.444381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44731465-3bd3-432b-8def-71b166a7ff1e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.444660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44731465-3bd3-432b-8def-71b166a7ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.474147 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-44731465-3bd3-432b-8def-71b166a7ff1e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:22.475461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-44731465-3bd3-432b-8def-71b166a7ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:22.484205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1141/2265] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:22.489412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15510-245a-4319-9875-a4d257980b55 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:22.498999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15510-245a-4319-9875-a4d257980b55 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:22.504182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:22.504779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.505055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.505352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.505998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:22.506303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.507948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:22.519807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1125/2266] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:15:22.524166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44731465-3bd3-432b-8def-71b166a7ff1e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:22.536213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44731465-3bd3-432b-8def-71b166a7ff1e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:22.540996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:22.541588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.541863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.542132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.542755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.544689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:22.568763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:22.568763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:22.584355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d93f47-21b4-49fb-8d08-96b0646a18fc admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:22.592668 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:22.593334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.594055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.594055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] PATH_INFO: `/v3/projects/ae11e2b287e44c81a6d8f4981ffc2307` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.595555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae11e2b287e44c81a6d8f4981ffc2307)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.597209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:22.670347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1142/2267] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:22 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:22.671594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:22.717442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae11e2b287e44c81a6d8f4981ffc2307', 'request_id': 'req-87eceabd-2c55-4147-a0fa-c1eda80572f3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.726055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae11e2b287e44c81a6d8f4981ffc2307', 'request_id': 'req-87eceabd-2c55-4147-a0fa-c1eda80572f3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.745707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a71d1-0a0d-4709-9c1d-5ad66769ebc7 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:22.805192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:22.806939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.806939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.806939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.807244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.809406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:22.818224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae11e2b287e44c81a6d8f4981ffc2307', 'request_id': 'req-87eceabd-2c55-4147-a0fa-c1eda80572f3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.833030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] The token cache is being invalidate because project ae11e2b287e44c81a6d8f4981ffc2307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:22.833336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.834043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-87eceabd-2c55-4147-a0fa-c1eda80572f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:22.835552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1126/2268] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:22 2022] DELETE /identity/v3/projects/ae11e2b287e44c81a6d8f4981ffc2307 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:22.840438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752347-2565-487e-a78f-8e615bfa8d0d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.840717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752347-2565-487e-a78f-8e615bfa8d0d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.840986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a752347-2565-487e-a78f-8e615bfa8d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.862363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-7a752347-2565-487e-a78f-8e615bfa8d0d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:22.863727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7a752347-2565-487e-a78f-8e615bfa8d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:22.874066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1127/2269] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:22.881791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492ef4-e4b1-4250-bc40-702f3768d598 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.882080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492ef4-e4b1-4250-bc40-702f3768d598 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.882358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c492ef4-e4b1-4250-bc40-702f3768d598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.902437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5c492ef4-e4b1-4250-bc40-702f3768d598 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:22.903493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5c492ef4-e4b1-4250-bc40-702f3768d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:22.912773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1128/2270] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:22.916880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492ef4-e4b1-4250-bc40-702f3768d598 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:22.941415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c492ef4-e4b1-4250-bc40-702f3768d598 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:22.946351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:22.948204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.948204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.948204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.948460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:22.948887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.950527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:22.957101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1143/2271] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:22 2022] POST /identity/v3/users => generated 286 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:15:22.961271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:22.963127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:22.966807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1129/2272] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:15:22.967790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:22.977574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc04d1-acc1-4d11-bd7c-70fd616953d4 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:22.978574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906130fe-1829-4e33-86e6-4ac9427255b9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:22.983068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:22.983690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.983864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:22.984071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.984301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.984538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:22.984823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:22.984960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.985211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:22.986554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:22.987755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:22.988865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.000372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1144/2273] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:15:23.004389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.016105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa746f-8941-464e-82c6-6ffd37e22b46 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.020127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.020732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.021044 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.021316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.021968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.023759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.037975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1145/2274] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:15:23.037975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.037975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:23.094857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66cdb7-475b-4b71-95a6-7f5809978f1d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.099178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.099792 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.100106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.100384 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.102273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:23.138898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1130/2275] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:22 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:23.138898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.172485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.174214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.185159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1146/2276] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:23.185995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.196694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7ec06-c0b5-4522-9113-a65b7aba87e3 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.217270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858c56-af3b-4d8a-a70c-870a0f6c6518 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.234695 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e97869-1b56-4710-9ecc-dca4cb6eed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.235515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97869-1b56-4710-9ecc-dca4cb6eed6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.236061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97869-1b56-4710-9ecc-dca4cb6eed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.236343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e97869-1b56-4710-9ecc-dca4cb6eed6d admin admin] PATH_INFO: `/v3/projects/4f9ccb4755bf494592ec9e3114555111/users/6e30b4b9387841cdafec55e713085244/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.257631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97869-1b56-4710-9ecc-dca4cb6eed6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9ccb4755bf494592ec9e3114555111, user_id=6e30b4b9387841cdafec55e713085244, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.260470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e97869-1b56-4710-9ecc-dca4cb6eed6d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.262267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.262914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.263194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.263631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.264466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.266469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.299176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:23.436374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1131/2277] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:23 2022] PUT /identity/v3/projects/4f9ccb4755bf494592ec9e3114555111/users/6e30b4b9387841cdafec55e713085244/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:23.437555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1147/2278] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:23 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:23.443180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.443571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.443925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.444679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.457304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709e81-6071-468e-9c0a-3ba6c2bc0bc2 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.464368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:23.465665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:23.532546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1132/2279] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:23.539375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.540126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.540419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.540692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.541399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.543354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.544518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.546559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:23.556488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1148/2280] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:15:23.559022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.570052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b0f4d-846e-459e-8882-d44eed8ce421 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.574903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.575510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.575795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.576457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.576861 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.578627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.592545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1149/2281] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:23.596663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.607715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb608db2-f5ac-432b-a64c-5907e25f02e8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.613927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.614686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.614925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.615212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] PATH_INFO: `/v3/projects/4c91e208b56142ca979666f5f845c610/users/a2fe6faec0c046918979731db8e0e05d/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.628023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d19d98-a4b0-4a3d-b075-4c2dd5f19841 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.633030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c91e208b56142ca979666f5f845c610, user_id=a2fe6faec0c046918979731db8e0e05d, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.634287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0736fbf-6c0d-4ddb-9086-34a1b7c5348c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.634984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736fbf-6c0d-4ddb-9086-34a1b7c5348c service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.635271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736fbf-6c0d-4ddb-9086-34a1b7c5348c service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.635671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0736fbf-6c0d-4ddb-9086-34a1b7c5348c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.635770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.647570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0736fbf-6c0d-4ddb-9086-34a1b7c5348c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.649183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0736fbf-6c0d-4ddb-9086-34a1b7c5348c service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.661963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1133/2282] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:15:23.731489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1150/2283] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:23 2022] PUT /identity/v3/projects/4c91e208b56142ca979666f5f845c610/users/a2fe6faec0c046918979731db8e0e05d/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:23.743224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ac12a-4963-456c-9658-56063ff11976 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.743511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ac12a-4963-456c-9658-56063ff11976 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.743791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ac12a-4963-456c-9658-56063ff11976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.772660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2b9ac12a-4963-456c-9658-56063ff11976 None None] MFA Rules not processed for user `a2fe6faec0c046918979731db8e0e05d`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:23.773890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2b9ac12a-4963-456c-9658-56063ff11976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:23.846386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1134/2284] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:23.857810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:23.859564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:23.923823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edfddf-46b2-4d9a-b670-25255000c88b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:23.927881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d665b7-57ae-4d3a-9a7b-94d7c6f74d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:23.928522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d665b7-57ae-4d3a-9a7b-94d7c6f74d14 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:23.928801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d665b7-57ae-4d3a-9a7b-94d7c6f74d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:23.929074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d665b7-57ae-4d3a-9a7b-94d7c6f74d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:23.937734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d665b7-57ae-4d3a-9a7b-94d7c6f74d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:23.939733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d665b7-57ae-4d3a-9a7b-94d7c6f74d14 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:23.952516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1151/2285] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:23.972200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ac12a-4963-456c-9658-56063ff11976 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:24.046541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ac12a-4963-456c-9658-56063ff11976 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:24.052381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:24.053352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:24.053352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:24.053550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] PATH_INFO: `/v3/users/a2fe6faec0c046918979731db8e0e05d` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:24.054803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2fe6faec0c046918979731db8e0e05d)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:24.057031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:24.369459 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2fe6faec0c046918979731db8e0e05d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:24.372551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2fe6faec0c046918979731db8e0e05d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:24.372551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2fe6faec0c046918979731db8e0e05d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:24.425687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:24.491246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2fe6faec0c046918979731db8e0e05d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:24.499142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2fe6faec0c046918979731db8e0e05d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:24.517367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1135/2286] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:23 2022] DELETE /identity/v3/users/a2fe6faec0c046918979731db8e0e05d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:24.521860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:24.522374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:24.522467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:24.546941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:24.549288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:24.641314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1152/2287] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:24.651885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:24.654332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:24.734843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80905-9a80-4a24-92d8-34d85c188110 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:24.739202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b5e2-1ea5-41bf-891e-d638afed85b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:24.739813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b5e2-1ea5-41bf-891e-d638afed85b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:24.740122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b5e2-1ea5-41bf-891e-d638afed85b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:24.740398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b5e2-1ea5-41bf-891e-d638afed85b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:24.749846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b5e2-1ea5-41bf-891e-d638afed85b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:24.751253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b5e2-1ea5-41bf-891e-d638afed85b9 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:24.762622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1136/2288] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:25.363218 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:25.364933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:25.378851 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5324f4-a8cc-4e34-9385-b8049380af31 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:25.383817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:25.384564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:25.384918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:25.385259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] PATH_INFO: `/v3/projects/4c91e208b56142ca979666f5f845c610` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:25.386348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c91e208b56142ca979666f5f845c610)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:25.388334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:25.575765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c91e208b56142ca979666f5f845c610', 'request_id': 'req-8118b1d7-293f-45bb-ad78-11101b7054c1'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:25.583374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c91e208b56142ca979666f5f845c610', 'request_id': 'req-8118b1d7-293f-45bb-ad78-11101b7054c1'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:25.652167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c91e208b56142ca979666f5f845c610', 'request_id': 'req-8118b1d7-293f-45bb-ad78-11101b7054c1'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:25.665095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] The token cache is being invalidate because project 4c91e208b56142ca979666f5f845c610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:25.665417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:25.666269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8118b1d7-293f-45bb-ad78-11101b7054c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:25.667996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1153/2289] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:25 2022] DELETE /identity/v3/projects/4c91e208b56142ca979666f5f845c610 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:25.674033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a86e0-f74a-4aba-bcca-111e257cab76 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:25.674529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a86e0-f74a-4aba-bcca-111e257cab76 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:25.674623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a86e0-f74a-4aba-bcca-111e257cab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:25.696525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-351a86e0-f74a-4aba-bcca-111e257cab76 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:25.698028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-351a86e0-f74a-4aba-bcca-111e257cab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:25.760574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1137/2290] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:25.768533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed6dde-822c-43f4-8eda-06c2fded60d0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:25.768668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed6dde-822c-43f4-8eda-06c2fded60d0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:25.768926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed6dde-822c-43f4-8eda-06c2fded60d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:25.791618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-47ed6dde-822c-43f4-8eda-06c2fded60d0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:25.794285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-47ed6dde-822c-43f4-8eda-06c2fded60d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:25.801907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1154/2291] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:25.806056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a86e0-f74a-4aba-bcca-111e257cab76 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:25.816268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a86e0-f74a-4aba-bcca-111e257cab76 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:25.822074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:25.827160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:25.827447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:25.827777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:25.828498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:25.828813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:25.831059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:25.846946 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1138/2292] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:15:25.848175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed6dde-822c-43f4-8eda-06c2fded60d0 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:25.857796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed6dde-822c-43f4-8eda-06c2fded60d0 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:25.865088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:25.865739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:25.866018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:25.866291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:25.866924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:25.868969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:25.927661 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:25.971650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1155/2293] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:25 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:25.972940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:25.977113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:25.990408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43ab89-7c6b-4ea3-a2d5-3dd9e54994fc admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:26.068478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:26.069268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:26.069546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:26.069815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:26.070532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:26.073143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:26.207807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1139/2294] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:25 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:26.212344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:26.224515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38079e-2a0d-4339-9825-df9c05ecb515 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:26.229695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:26.230678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:26.231110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:26.231535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:26.232421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:26.234612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:26.252950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1156/2295] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:26.269012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:26.289802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea44aed-0619-4df9-bc59-38a2db332f31 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:26.298380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698149e-bbed-4fe2-a773-ec7217e76101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:26.299758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698149e-bbed-4fe2-a773-ec7217e76101 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:26.302671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698149e-bbed-4fe2-a773-ec7217e76101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:26.302671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698149e-bbed-4fe2-a773-ec7217e76101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:26.302671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698149e-bbed-4fe2-a773-ec7217e76101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:26.303823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698149e-bbed-4fe2-a773-ec7217e76101 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:26.318181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1140/2296] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:26.322345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:26.334143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf0d7-7756-49f8-b6eb-1147d67960c6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:26.340484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:26.342779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:26.342779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:26.342779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] PATH_INFO: `/v3/projects/d6884f582926405e97b0cb71b38b8ea5/users/b7b1fbcf197549da9a9f1095ee9b7bf8/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:26.371112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6884f582926405e97b0cb71b38b8ea5, user_id=b7b1fbcf197549da9a9f1095ee9b7bf8, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:26.388833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:26.612049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1157/2297] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:26 2022] PUT /identity/v3/projects/d6884f582926405e97b0cb71b38b8ea5/users/b7b1fbcf197549da9a9f1095ee9b7bf8/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:26.614926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404f26-2532-4814-8e7d-c2e78e5abd8a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:26.616985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404f26-2532-4814-8e7d-c2e78e5abd8a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:26.616985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25404f26-2532-4814-8e7d-c2e78e5abd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:26.654749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-25404f26-2532-4814-8e7d-c2e78e5abd8a None None] MFA Rules not processed for user `b7b1fbcf197549da9a9f1095ee9b7bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:26.655921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-25404f26-2532-4814-8e7d-c2e78e5abd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:26.742050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1141/2298] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:26.746305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:26.816479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995cb3f-c7fa-4422-8353-e7e99b0e3df2 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:26.822550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:26.823167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:26.823613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:26.824101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:26.824943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:26.827023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:26.998919 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1158/2299] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:26 2022] POST /identity/v3/projects => generated 375 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:27.004539 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25404f26-2532-4814-8e7d-c2e78e5abd8a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:27.019812 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25404f26-2532-4814-8e7d-c2e78e5abd8a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:27.120246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:27.120875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:27.121162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:27.124258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:27.124258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:27.124258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:27.329557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1142/2300] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:27 2022] POST /identity/v3/users => generated 294 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:27.333735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:27.348018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f93000-6ae7-4104-8b11-a57f208e61e6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:27.356939 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:27.357565 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:27.357847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:27.358122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:27.359713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:27.367132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:27.395721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1159/2301] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:27.397559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:27.424845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599daa-749d-4205-8079-eb9f6afc0a44 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:27.441411 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:27.442271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:27.442704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:27.443056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] PATH_INFO: `/v3/projects/30a4d69a10764c4ba2a3ac65b6723e82/users/65027157eda245ccbde304c3a99ea172/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:27.473059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a4d69a10764c4ba2a3ac65b6723e82, user_id=65027157eda245ccbde304c3a99ea172, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:27.476243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:27.635988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1143/2302] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:27 2022] PUT /identity/v3/projects/30a4d69a10764c4ba2a3ac65b6723e82/users/65027157eda245ccbde304c3a99ea172/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:27.637877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:27.649613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750bca1-08cb-43ed-a118-fed751bc9f17 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:27.734650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d02ea-b881-4a31-9ebd-3370e6c9aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:27.735243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d02ea-b881-4a31-9ebd-3370e6c9aead admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:27.735723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d02ea-b881-4a31-9ebd-3370e6c9aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:27.736340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d02ea-b881-4a31-9ebd-3370e6c9aead admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:27.737422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d02ea-b881-4a31-9ebd-3370e6c9aead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:27.740777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d02ea-b881-4a31-9ebd-3370e6c9aead admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:27.755707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1160/2303] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:27.757327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:27.773122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d4ae-97a0-437e-bb90-2210642005fe admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:27.784745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:27.785427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:27.785706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:27.785988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] PATH_INFO: `/v3/projects/30a4d69a10764c4ba2a3ac65b6723e82/users/65027157eda245ccbde304c3a99ea172/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:27.789417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a4d69a10764c4ba2a3ac65b6723e82, user_id=65027157eda245ccbde304c3a99ea172, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:27.795142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:27.815482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1144/2304] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:27 2022] PUT /identity/v3/projects/30a4d69a10764c4ba2a3ac65b6723e82/users/65027157eda245ccbde304c3a99ea172/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:27.823400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92f1e-2f89-4a42-b2dd-87fe3e239c9b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:27.824047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92f1e-2f89-4a42-b2dd-87fe3e239c9b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:27.824283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db92f1e-2f89-4a42-b2dd-87fe3e239c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:27.878069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7db92f1e-2f89-4a42-b2dd-87fe3e239c9b None None] MFA Rules not processed for user `65027157eda245ccbde304c3a99ea172`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:27.879785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7db92f1e-2f89-4a42-b2dd-87fe3e239c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:28.021788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1161/2305] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:28.033366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:28.035544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:28.146290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611012c5-e029-4813-8a1e-3a34bd98daba admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:28.152065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:28.152932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:28.153502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:28.154065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:28.258787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:28.260628 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:28.284101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1145/2306] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:28.993516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:29.995168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:31.494391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:31.578693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00862-d751-4447-96ae-f4459bca42de None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:31.580517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00862-d751-4447-96ae-f4459bca42de None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:31.581214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00862-d751-4447-96ae-f4459bca42de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:31.605662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e4e00862-d751-4447-96ae-f4459bca42de None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:31.607280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e4e00862-d751-4447-96ae-f4459bca42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:31.761922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1162/2307] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:15:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:31.838077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:31.841372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:31.965409 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac21981-c125-4b2e-a5c5-875de111b471 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:31.979755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0f9c8-2491-424a-ae93-acf1b6f2bcc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:31.980421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f9c8-2491-424a-ae93-acf1b6f2bcc2 service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:31.980701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f9c8-2491-424a-ae93-acf1b6f2bcc2 service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:31.981148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0f9c8-2491-424a-ae93-acf1b6f2bcc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:31.999919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f9c8-2491-424a-ae93-acf1b6f2bcc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:32.001842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0f9c8-2491-424a-ae93-acf1b6f2bcc2 service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:32.017018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1146/2308] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:15:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:15:32.128724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e00862-d751-4447-96ae-f4459bca42de None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:32.298285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e00862-d751-4447-96ae-f4459bca42de None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:32.308969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:32.310777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:32.311209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:32.311678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] PATH_INFO: `/v3/users/b7b1fbcf197549da9a9f1095ee9b7bf8` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:32.314334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b1fbcf197549da9a9f1095ee9b7bf8)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:32.317364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:32.571550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b1fbcf197549da9a9f1095ee9b7bf8'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:32.589190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b1fbcf197549da9a9f1095ee9b7bf8'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:32.593417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b1fbcf197549da9a9f1095ee9b7bf8'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:32.693035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b1fbcf197549da9a9f1095ee9b7bf8'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:32.715369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b1fbcf197549da9a9f1095ee9b7bf8'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:32.726689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1163/2309] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:32 2022] DELETE /identity/v3/users/b7b1fbcf197549da9a9f1095ee9b7bf8 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:32.731237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce61b-87f5-480c-877f-839e4111df95 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:32.732204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce61b-87f5-480c-877f-839e4111df95 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:32.733840 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ce61b-87f5-480c-877f-839e4111df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:32.769854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-948ce61b-87f5-480c-877f-839e4111df95 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:32.772560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-948ce61b-87f5-480c-877f-839e4111df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:32.925034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1147/2310] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:32.938581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:32.940611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:33.067249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74f51-6a0e-4276-a3f2-15334e638256 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:33.071776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:33.072649 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:33.072933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:33.073259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:33.099242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:33.101382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:33.128042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1164/2311] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:33.371866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ab83-f58e-482c-934d-2ed1f0636f95 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:33.372180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ab83-f58e-482c-934d-2ed1f0636f95 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:33.372455 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ab83-f58e-482c-934d-2ed1f0636f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:33.466691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-62e5ab83-f58e-482c-934d-2ed1f0636f95 None None] MFA Rules not processed for user `6e30b4b9387841cdafec55e713085244`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:33.471462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-62e5ab83-f58e-482c-934d-2ed1f0636f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:33.634976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1148/2312] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:33.636242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:33.638290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:33.659382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f938b-9ad3-4e15-bffb-b27308ba43dc service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:33.675844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:33.676883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:33.677385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:33.677866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:33.678695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:33.680960 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:33.853761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1165/2313] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:33.857635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ab83-f58e-482c-934d-2ed1f0636f95 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:33.876304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ab83-f58e-482c-934d-2ed1f0636f95 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:34.004953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:34.005707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:34.006268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:34.006761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:34.007605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:34.009860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:34.083210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:34.087175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:34.105050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a623f-584f-409d-82e1-8505c47f07a0 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:34.112314 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:34.113431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:34.113912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:34.114387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] PATH_INFO: `/v3/projects/d6884f582926405e97b0cb71b38b8ea5` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:34.116329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6884f582926405e97b0cb71b38b8ea5)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:34.118767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:34.136886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1149/2314] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:33 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:15:34.138389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:34.159137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1e285-c7bf-45e1-84d6-1e92c6ea651b admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:34.172332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:34.173235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:34.174775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:34.175157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:34.177184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:34.184039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:34.233542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1150/2315] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:15:34.234785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:34.274813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc628a5-d3d1-43e0-9fed-fbf382166fda admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:34.275391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:34.288371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6884f582926405e97b0cb71b38b8ea5', 'request_id': 'req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:34.296567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6884f582926405e97b0cb71b38b8ea5', 'request_id': 'req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:34.402232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6884f582926405e97b0cb71b38b8ea5', 'request_id': 'req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:34.421483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:34.422167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:34.423069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:34.423382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] The token cache is being invalidate because project d6884f582926405e97b0cb71b38b8ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:34.423505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] PATH_INFO: `/v3/projects/789ef79efd2d48a6bbcb168fdd5e8bcb/users/74d8c0fdbfc740b1a065513b346506f7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:34.423853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:34.429952 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:34.437522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1166/2316] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:34 2022] DELETE /identity/v3/projects/d6884f582926405e97b0cb71b38b8ea5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:34.438945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:34.443559 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:34.465572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789ef79efd2d48a6bbcb168fdd5e8bcb, user_id=74d8c0fdbfc740b1a065513b346506f7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:34.470258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:34.494000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb4a4a-5ebd-4112-a1e3-97dc8072a2ab admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:34.502889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:34.503675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:34.504101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:34.504471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] PATH_INFO: `/v3/users/65027157eda245ccbde304c3a99ea172` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:34.506008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65027157eda245ccbde304c3a99ea172)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:34.508201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:34.599174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1151/2317] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:34 2022] PUT /identity/v3/projects/789ef79efd2d48a6bbcb168fdd5e8bcb/users/74d8c0fdbfc740b1a065513b346506f7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:34.601485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:34.603972 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:34.692609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b897-6000-494b-8853-09f69dde7575 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:34.698071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:34.698908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:34.699183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:34.699659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:34.700643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:34.702503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:34.725223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1152/2318] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:34.726957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:34.738937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96822da-a38d-437c-bd46-2b2415951eea admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:34.748956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:34.753609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:34.753609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:34.753609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] PATH_INFO: `/v3/projects/789ef79efd2d48a6bbcb168fdd5e8bcb/users/74d8c0fdbfc740b1a065513b346506f7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:34.753609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789ef79efd2d48a6bbcb168fdd5e8bcb, user_id=74d8c0fdbfc740b1a065513b346506f7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:34.757517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:34.764845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65027157eda245ccbde304c3a99ea172'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:34.773138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1153/2319] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:34 2022] PUT /identity/v3/projects/789ef79efd2d48a6bbcb168fdd5e8bcb/users/74d8c0fdbfc740b1a065513b346506f7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:34.805773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65027157eda245ccbde304c3a99ea172'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:34.807485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65027157eda245ccbde304c3a99ea172'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:35.058148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65027157eda245ccbde304c3a99ea172'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:35.078318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-dfc74b84-507b-414a-9af1-2e760c527b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65027157eda245ccbde304c3a99ea172'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:35.098007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1167/2320] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:34 2022] DELETE /identity/v3/users/65027157eda245ccbde304c3a99ea172 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:35.797403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:36.414772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:36.417036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:36.580448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb8446-f159-4498-a7b2-bd866faa5e39 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:36.738839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:36.739822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:36.740689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:36.741195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] PATH_INFO: `/v3/projects/30a4d69a10764c4ba2a3ac65b6723e82` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:36.742911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a4d69a10764c4ba2a3ac65b6723e82)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:36.745484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:36.951343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a4d69a10764c4ba2a3ac65b6723e82', 'request_id': 'req-f116ad31-b000-4dcd-a96f-fb8528769007'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:36.961670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a4d69a10764c4ba2a3ac65b6723e82', 'request_id': 'req-f116ad31-b000-4dcd-a96f-fb8528769007'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:37.464405 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a4d69a10764c4ba2a3ac65b6723e82', 'request_id': 'req-f116ad31-b000-4dcd-a96f-fb8528769007'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:37.476422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] The token cache is being invalidate because project 30a4d69a10764c4ba2a3ac65b6723e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:37.476720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:37.477379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f116ad31-b000-4dcd-a96f-fb8528769007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:37.494084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1154/2321] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:36 2022] DELETE /identity/v3/projects/30a4d69a10764c4ba2a3ac65b6723e82 => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:37.499418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2df6e-36e1-4412-aaf9-34f9aa58bf8a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:37.499971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2df6e-36e1-4412-aaf9-34f9aa58bf8a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:37.500074 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2df6e-36e1-4412-aaf9-34f9aa58bf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:37.526683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a3e2df6e-36e1-4412-aaf9-34f9aa58bf8a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:37.528020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a3e2df6e-36e1-4412-aaf9-34f9aa58bf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:37.602385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1168/2322] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:37.610863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ee1-775e-4a28-b5a0-ae9e2a29d75e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:37.611195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ee1-775e-4a28-b5a0-ae9e2a29d75e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:37.611475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f269ee1-775e-4a28-b5a0-ae9e2a29d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:37.632035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2f269ee1-775e-4a28-b5a0-ae9e2a29d75e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:37.633278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2f269ee1-775e-4a28-b5a0-ae9e2a29d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:37.641369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1155/2323] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:37.645629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2df6e-36e1-4412-aaf9-34f9aa58bf8a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:37.657318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2df6e-36e1-4412-aaf9-34f9aa58bf8a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:37.662911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:37.663729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:37.664056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:37.664441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:37.665285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:37.665667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:37.667304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:37.684964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1169/2324] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:15:37.690992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f269ee1-775e-4a28-b5a0-ae9e2a29d75e None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:37.700763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f269ee1-775e-4a28-b5a0-ae9e2a29d75e None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:37.705890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:37.706353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:37.706762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:37.707035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:37.708024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:37.714775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:37.851652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:37.859701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1156/2325] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:37 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:15:37.863763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d61b8-d638-4bae-812c-13ff4e76ced5 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:38.008600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:38.009227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:38.009506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:38.009784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:38.010419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:38.013171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:38.156168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1170/2326] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:37 2022] POST /identity/v3/users => generated 286 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:38.157564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:38.168610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced78d9-03aa-4071-9441-0f7f4b095d33 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:38.184738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:38.185361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:38.185635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:38.185903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:38.186555 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:38.188310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:38.220657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:38.221137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1157/2327] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:15:38.248105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d3421-badc-410d-96b8-4d0e90ca2785 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:38.261087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b100-2375-47a0-b2fe-c86bdfc462da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:38.261709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b100-2375-47a0-b2fe-c86bdfc462da admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:38.262226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b100-2375-47a0-b2fe-c86bdfc462da admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:38.262511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b100-2375-47a0-b2fe-c86bdfc462da admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:38.263191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b100-2375-47a0-b2fe-c86bdfc462da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:38.267571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b100-2375-47a0-b2fe-c86bdfc462da admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:38.298880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:38.299341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1171/2328] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:38.316046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993206-f61e-41d8-bf74-2e5a1ebe95e4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:38.331808 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:38.341371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:38.341371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:38.341371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] PATH_INFO: `/v3/projects/faf7918e23f546c48abd46b58ec31e1b/users/f6684edf647e4c11b414742e8dcd71e3/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:38.364257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf7918e23f546c48abd46b58ec31e1b, user_id=f6684edf647e4c11b414742e8dcd71e3, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:38.366297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:38.515025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1158/2329] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:38 2022] PUT /identity/v3/projects/faf7918e23f546c48abd46b58ec31e1b/users/f6684edf647e4c11b414742e8dcd71e3/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:38.515747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:38.516282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:38.516471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:38.555579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] MFA Rules not processed for user `f6684edf647e4c11b414742e8dcd71e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:38.556887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:38.721852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1172/2330] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:38.737253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:38.740418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:38.835136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d88d-6b9e-4d17-98e1-5757f6ac8532 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:38.844756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad185068-8119-4675-a29c-d44d95813fb2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:38.846043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad185068-8119-4675-a29c-d44d95813fb2 service glance] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:38.846426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad185068-8119-4675-a29c-d44d95813fb2 service glance] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:38.846793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad185068-8119-4675-a29c-d44d95813fb2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:38.858331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad185068-8119-4675-a29c-d44d95813fb2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:38.861669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad185068-8119-4675-a29c-d44d95813fb2 service glance] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:38.874890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1159/2331] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:38.887143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:40.161244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:40.543891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:40.546341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:40.688895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700ea79-b639-4fbd-bd3e-7416f96c8946 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:40.698413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:40.699081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:40.699426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:40.699703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] PATH_INFO: `/v3/users/718dfe116af148159c5e9561bacfd4bc` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:40.712683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=718dfe116af148159c5e9561bacfd4bc)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:40.718739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:40.969363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718dfe116af148159c5e9561bacfd4bc'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:41.012636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718dfe116af148159c5e9561bacfd4bc'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:41.014665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718dfe116af148159c5e9561bacfd4bc'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:41.130243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718dfe116af148159c5e9561bacfd4bc'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:41.145451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718dfe116af148159c5e9561bacfd4bc'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:41.158280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1173/2332] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:40 2022] DELETE /identity/v3/users/718dfe116af148159c5e9561bacfd4bc => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:41.162899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:41.163435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:41.163435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:41.223763 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:41.235705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:41.417156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1160/2333] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:41.429060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:41.432171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:41.511399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:41.579432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f8f69-41f5-4b26-8d78-63857ac74367 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:41.586217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a10bc-6551-4789-92f0-b0fc7f48d70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:41.587127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a10bc-6551-4789-92f0-b0fc7f48d70e service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:41.588320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a10bc-6551-4789-92f0-b0fc7f48d70e service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:41.588817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a10bc-6551-4789-92f0-b0fc7f48d70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:41.607152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a10bc-6551-4789-92f0-b0fc7f48d70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:41.610558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a10bc-6551-4789-92f0-b0fc7f48d70e service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:41.627118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1174/2334] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:42.956566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:42.957957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:42.974018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4b07b-953c-4be8-8723-77cb173b18a0 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:42.980823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:42.982069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:42.989269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:42.989269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] PATH_INFO: `/v3/projects/a63bbd7be4cf4e05a5dbc16a4834d800` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:42.989269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63bbd7be4cf4e05a5dbc16a4834d800)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:42.989269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:44.043857 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63bbd7be4cf4e05a5dbc16a4834d800', 'request_id': 'req-39a21069-1296-4f79-8db2-5d0ac06c5ca8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:44.066215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63bbd7be4cf4e05a5dbc16a4834d800', 'request_id': 'req-39a21069-1296-4f79-8db2-5d0ac06c5ca8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:44.240799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63bbd7be4cf4e05a5dbc16a4834d800', 'request_id': 'req-39a21069-1296-4f79-8db2-5d0ac06c5ca8'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:44.258971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] The token cache is being invalidate because project a63bbd7be4cf4e05a5dbc16a4834d800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:44.259665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:44.260608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-39a21069-1296-4f79-8db2-5d0ac06c5ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:44.266993 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1161/2335] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:42 2022] DELETE /identity/v3/projects/a63bbd7be4cf4e05a5dbc16a4834d800 => generated 0 bytes in 1307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:44.268987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b287d8-4417-440c-a1e6-05bbef2b0aa0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:44.268987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b287d8-4417-440c-a1e6-05bbef2b0aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:44.269442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b287d8-4417-440c-a1e6-05bbef2b0aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:44.304834 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-06b287d8-4417-440c-a1e6-05bbef2b0aa0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:44.306777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-06b287d8-4417-440c-a1e6-05bbef2b0aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:44.459963 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1175/2336] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:44.468548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028db3-dd9d-4632-83e0-ce7d17aba3da None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:44.469705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028db3-dd9d-4632-83e0-ce7d17aba3da None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:44.470497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0028db3-dd9d-4632-83e0-ce7d17aba3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:44.501036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c0028db3-dd9d-4632-83e0-ce7d17aba3da None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:44.502907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c0028db3-dd9d-4632-83e0-ce7d17aba3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:44.539312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b287d8-4417-440c-a1e6-05bbef2b0aa0 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:44.539542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1162/2337] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:15:44.561470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b287d8-4417-440c-a1e6-05bbef2b0aa0 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:44.590068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:44.590752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:44.591036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:44.591732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:44.593035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:44.593035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:44.595972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:44.627611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1176/2338] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:15:44.632584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028db3-dd9d-4632-83e0-ce7d17aba3da None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:44.643248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0028db3-dd9d-4632-83e0-ce7d17aba3da None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:44.650502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:44.651587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:44.652156 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:44.652747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:44.654151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:44.658373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:44.830683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1163/2339] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:44 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:44.831877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:44.856622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d930a-2a32-44a9-8111-c2e42c573564 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:44.952001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:44.996151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:44.997334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:44.997853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:44.998334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:45.004435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:45.006423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:45.086832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:45.143264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1177/2340] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:44 2022] POST /identity/v3/users => generated 283 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:45.143764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:45.154674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ed08c-6104-463c-a4d4-120e39191cbf admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:45.183551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:45.184212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:45.184492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:45.184766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:45.185424 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:45.188943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:45.227064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1164/2341] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:45.232254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:45.246038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c48572-1836-418d-8681-3593e5f83d96 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:45.263084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725e835-8ec1-4ad9-9417-a8ec847aaff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:45.263706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725e835-8ec1-4ad9-9417-a8ec847aaff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:45.264009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725e835-8ec1-4ad9-9417-a8ec847aaff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:45.264288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725e835-8ec1-4ad9-9417-a8ec847aaff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:45.269575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725e835-8ec1-4ad9-9417-a8ec847aaff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:45.276656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725e835-8ec1-4ad9-9417-a8ec847aaff3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:45.327650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1178/2342] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:45.338561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:45.374616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd91af-a05f-44a3-af92-7fa74a2cc37d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:45.390373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:45.391621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:45.391925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:45.392241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] PATH_INFO: `/v3/projects/0e15fcef623b4a8390f85117381f54e7/users/1b9839411b874b96a1b95faa71e3c969/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:45.435975 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e15fcef623b4a8390f85117381f54e7, user_id=1b9839411b874b96a1b95faa71e3c969, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:45.442057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:45.569011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1165/2343] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:15:45 2022] PUT /identity/v3/projects/0e15fcef623b4a8390f85117381f54e7/users/1b9839411b874b96a1b95faa71e3c969/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:45.581727 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3943-e735-4017-9ae3-e64e1c2cb043 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:45.583488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3943-e735-4017-9ae3-e64e1c2cb043 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:45.584271 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3943-e735-4017-9ae3-e64e1c2cb043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:45.696122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-0d2c3943-e735-4017-9ae3-e64e1c2cb043 None None] MFA Rules not processed for user `1b9839411b874b96a1b95faa71e3c969`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:45.697655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0d2c3943-e735-4017-9ae3-e64e1c2cb043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:45.724983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:45.836374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1179/2344] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:45.851836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:45.855150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:46.029973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605120d2-8d79-45e6-84e4-ff6ed63251db admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:46.034260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:46.048314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:46.048314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:46.048314 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:46.067722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:46.069522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:46.115187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1166/2345] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:47.372564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:47.497160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd98c0-17d8-420c-9d7a-b38209946f73 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:47.497556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd98c0-17d8-420c-9d7a-b38209946f73 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:47.497941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd98c0-17d8-420c-9d7a-b38209946f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:47.570061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e9cd98c0-17d8-420c-9d7a-b38209946f73 None None] MFA Rules not processed for user `74d8c0fdbfc740b1a065513b346506f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:47.571589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e9cd98c0-17d8-420c-9d7a-b38209946f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:47.700468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1180/2346] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:47.708678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:47.712819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:47.825677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ad9ae-a3ca-4c28-bd85-57b5dbb2ff13 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:47.834868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c32476-a367-4505-a191-30a444b3a45d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:47.835762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32476-a367-4505-a191-30a444b3a45d service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:47.836171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32476-a367-4505-a191-30a444b3a45d service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:47.836541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c32476-a367-4505-a191-30a444b3a45d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:47.849762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-94c32476-a367-4505-a191-30a444b3a45d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:48.011554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32476-a367-4505-a191-30a444b3a45d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:48.014847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c32476-a367-4505-a191-30a444b3a45d service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:48.047760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1167/2347] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:48.362256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:49.990192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:52.068699 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:53.262294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:53.331804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5fb55-6451-4d9d-a075-01b3ae09cdbe None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:53.332115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5fb55-6451-4d9d-a075-01b3ae09cdbe None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:53.332390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5fb55-6451-4d9d-a075-01b3ae09cdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:53.352618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-03e5fb55-6451-4d9d-a075-01b3ae09cdbe None None] MFA Rules not processed for user `6e30b4b9387841cdafec55e713085244`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:53.353876 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-03e5fb55-6451-4d9d-a075-01b3ae09cdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:53.365826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1181/2348] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:55.533962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a04c-fc4b-4253-a5dc-ce30c742dd7f None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:55.534491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a04c-fc4b-4253-a5dc-ce30c742dd7f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:55.534657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a04c-fc4b-4253-a5dc-ce30c742dd7f None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:55.536139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1168/2349] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:15:55.570827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:55.571691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:55.572410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:55.621259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] MFA Rules not processed for user `33f5a7148e3c4598ba93d35af2d564aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:55.622937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:55.724796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1182/2350] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:55.752148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397a04c-fc4b-4253-a5dc-ce30c742dd7f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:55.754022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2397a04c-fc4b-4253-a5dc-ce30c742dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:55.776304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397a04c-fc4b-4253-a5dc-ce30c742dd7f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:55.785827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:55.787151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:55.787794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:55.788436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:55.801559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:55.803581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:55.822068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1169/2351] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:15:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:15:55.943644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:56.641039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:56.642703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:56.725408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad62a40-74b4-4f61-93a8-ce8f99a3ca02 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:56.730676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:56.731327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:56.731605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:56.731880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] PATH_INFO: `/v3/users/76a15b9104a14b54ab2123e361d1bf7a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:56.733057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a15b9104a14b54ab2123e361d1bf7a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:56.735609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:56.822496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:57.008494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a15b9104a14b54ab2123e361d1bf7a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.021475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a15b9104a14b54ab2123e361d1bf7a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.022186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a15b9104a14b54ab2123e361d1bf7a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.104477 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a15b9104a14b54ab2123e361d1bf7a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.116718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a15b9104a14b54ab2123e361d1bf7a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.123728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1183/2352] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:56 2022] DELETE /identity/v3/users/76a15b9104a14b54ab2123e361d1bf7a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:15:57.430595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:57.451963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e562dd-e0d4-4902-abc9-cc4682720984 service placement] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:57.512072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:57.513495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:57.513775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:57.514054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] PATH_INFO: `/v3/projects/259f45ba5fc5405c8741b86182dbf565` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:57.516132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=259f45ba5fc5405c8741b86182dbf565)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:57.518979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:57.717026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259f45ba5fc5405c8741b86182dbf565', 'request_id': 'req-23ca10e9-2de1-4532-b29d-eb07f882acd6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.723397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259f45ba5fc5405c8741b86182dbf565', 'request_id': 'req-23ca10e9-2de1-4532-b29d-eb07f882acd6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.857761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259f45ba5fc5405c8741b86182dbf565', 'request_id': 'req-23ca10e9-2de1-4532-b29d-eb07f882acd6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.870481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] The token cache is being invalidate because project 259f45ba5fc5405c8741b86182dbf565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:57.870776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.871426 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:57.872976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1170/2353] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:57 2022] DELETE /identity/v3/projects/259f45ba5fc5405c8741b86182dbf565 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:57.878028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:57.880276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:57.895644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455d839-2ff7-409a-8f5f-459f97c0b3ce admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:57.958607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:57.959431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:57.959722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:57.960028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] PATH_INFO: `/v3/users/9736c6e86e4b47c788a4a9798bf9d4c9` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:57.961408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9736c6e86e4b47c788a4a9798bf9d4c9)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:57.963988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:58.188029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9736c6e86e4b47c788a4a9798bf9d4c9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:58.203882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9736c6e86e4b47c788a4a9798bf9d4c9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:58.204781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9736c6e86e4b47c788a4a9798bf9d4c9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:58.338114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9736c6e86e4b47c788a4a9798bf9d4c9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:58.348542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d98e65b1-a615-4d01-9b8a-9301248261e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9736c6e86e4b47c788a4a9798bf9d4c9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:58.354941 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1184/2354] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:15:57 2022] DELETE /identity/v3/users/9736c6e86e4b47c788a4a9798bf9d4c9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:58.724909 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:58.726604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:58.741531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca10e9-2de1-4532-b29d-eb07f882acd6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:58.820903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:58.821625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:58.821979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:58.822332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] PATH_INFO: `/v3/projects/6fb66e88688047868032b3c21deea2c8` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:58.823508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb66e88688047868032b3c21deea2c8)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:58.826196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:59.081915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb66e88688047868032b3c21deea2c8', 'request_id': 'req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:59.095950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb66e88688047868032b3c21deea2c8', 'request_id': 'req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:59.194694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb66e88688047868032b3c21deea2c8', 'request_id': 'req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:59.215184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] The token cache is being invalidate because project 6fb66e88688047868032b3c21deea2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:15:59.216010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:59.217031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e8b9117f-794a-4595-9f5e-bb1da0f3b6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:15:59.224658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1171/2355] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:15:58 2022] DELETE /identity/v3/projects/6fb66e88688047868032b3c21deea2c8 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:15:59.227238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8e630-b4f5-4baa-9d5c-2323c2584911 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:59.228041 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8e630-b4f5-4baa-9d5c-2323c2584911 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:59.228221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8e630-b4f5-4baa-9d5c-2323c2584911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:59.256884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-cbf8e630-b4f5-4baa-9d5c-2323c2584911 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:59.258444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-cbf8e630-b4f5-4baa-9d5c-2323c2584911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:59.330719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1185/2356] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:59.342586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b0d6-eb02-4e9f-915d-973dd9a4fc84 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:59.342867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b0d6-eb02-4e9f-915d-973dd9a4fc84 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:59.343137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b0d6-eb02-4e9f-915d-973dd9a4fc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:59.366856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ded0b0d6-eb02-4e9f-915d-973dd9a4fc84 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:15:59.368238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ded0b0d6-eb02-4e9f-915d-973dd9a4fc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:15:59.379610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1172/2357] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:15:59.384381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8e630-b4f5-4baa-9d5c-2323c2584911 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:59.396714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8e630-b4f5-4baa-9d5c-2323c2584911 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:59.404012 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:59.405035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:59.405493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:59.406771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:59.408237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:15:59.409004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:59.411935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:59.435962 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1186/2358] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:15:59.437470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b0d6-eb02-4e9f-915d-973dd9a4fc84 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:59.447107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b0d6-eb02-4e9f-915d-973dd9a4fc84 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:59.451927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:59.452605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:59.453559 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:59.453837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:59.454468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:59.457049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:59.615835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1173/2359] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:15:59 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:59.629484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:59.675357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1db2-d78d-4554-9aba-64552cb3355b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:59.773322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:59.774094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:59.774469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:59.774745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:59.775682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:59.777908 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:59.932879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1187/2360] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:15:59 2022] POST /identity/v3/users => generated 292 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:15:59.937047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:59.946063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:59.950607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eb783-c5ff-43b6-b3e9-bc64d8732d8a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:59.955641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:59.956297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:59.956572 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:59.956842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:59.957482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:59.959158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:15:59.970283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1174/2361] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:15:59.974602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:15:59.986434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dbb2a-e1ec-4305-af18-684de8face04 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:15:59.991576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300fb38-995e-4272-a26a-213e765b66ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:15:59.992202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300fb38-995e-4272-a26a-213e765b66ba admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:15:59.995447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300fb38-995e-4272-a26a-213e765b66ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:15:59.995447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300fb38-995e-4272-a26a-213e765b66ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:15:59.995447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300fb38-995e-4272-a26a-213e765b66ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:15:59.995447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300fb38-995e-4272-a26a-213e765b66ba admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:00.006555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1188/2362] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:16:00.011022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:00.022270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a06c7-07a4-40c1-a506-0cef081b50cb admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:00.026980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:00.027660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:00.027970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:00.028398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] PATH_INFO: `/v3/projects/1b5b51bf55ce4f8aa137cf7ca6b50b96/users/4e453693365c4907aa4bbe8c5ad9a131/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:00.044926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5b51bf55ce4f8aa137cf7ca6b50b96, user_id=4e453693365c4907aa4bbe8c5ad9a131, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:00.048904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:00.242807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1175/2363] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:16:00 2022] PUT /identity/v3/projects/1b5b51bf55ce4f8aa137cf7ca6b50b96/users/4e453693365c4907aa4bbe8c5ad9a131/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:16:00.254328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92988-f5a3-4dbc-aee4-b468ed4610bd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:00.254961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92988-f5a3-4dbc-aee4-b468ed4610bd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:00.254961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92988-f5a3-4dbc-aee4-b468ed4610bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:00.286095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a6b92988-f5a3-4dbc-aee4-b468ed4610bd None None] MFA Rules not processed for user `4e453693365c4907aa4bbe8c5ad9a131`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:00.287361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a6b92988-f5a3-4dbc-aee4-b468ed4610bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:00.356970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1189/2364] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:00.366747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:00.368560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:00.432245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106c3db-12da-43eb-9db7-9833d45207e6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:00.436146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44497946-a7e5-4c94-aa3d-d4ff076b09c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:00.436756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497946-a7e5-4c94-aa3d-d4ff076b09c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:00.437086 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497946-a7e5-4c94-aa3d-d4ff076b09c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:00.437361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44497946-a7e5-4c94-aa3d-d4ff076b09c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:00.446132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44497946-a7e5-4c94-aa3d-d4ff076b09c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:00.447594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44497946-a7e5-4c94-aa3d-d4ff076b09c9 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:00.456527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1176/2365] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:00.920972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:01.885629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb939-f76b-46bb-b919-5ca15d1f34be None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:01.885629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb939-f76b-46bb-b919-5ca15d1f34be None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:01.885629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb939-f76b-46bb-b919-5ca15d1f34be None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:01.885629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1190/2366] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:16:01.893067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b8681-ca5e-4d49-b804-7138408866d9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:01.893889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b8681-ca5e-4d49-b804-7138408866d9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:01.894321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b8681-ca5e-4d49-b804-7138408866d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:01.916474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-560b8681-ca5e-4d49-b804-7138408866d9 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:01.921886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-560b8681-ca5e-4d49-b804-7138408866d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:01.999285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1177/2367] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:16:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:02.010839 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bb939-f76b-46bb-b919-5ca15d1f34be None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:02.012563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9b0bb939-f76b-46bb-b919-5ca15d1f34be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:02.074095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bb939-f76b-46bb-b919-5ca15d1f34be None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:02.078284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061b52e-792e-42a1-860c-9c7dc313343e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:02.078888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b52e-792e-42a1-860c-9c7dc313343e service glance] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:02.079168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b52e-792e-42a1-860c-9c7dc313343e service glance] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:02.079436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b52e-792e-42a1-860c-9c7dc313343e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:02.089692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b52e-792e-42a1-860c-9c7dc313343e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:02.091198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061b52e-792e-42a1-860c-9c7dc313343e service glance] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:02.102733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1191/2368] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:02.380546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb40896-6fcc-44ac-8751-2948597de7ca None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:02.381098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb40896-6fcc-44ac-8751-2948597de7ca None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:02.381496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb40896-6fcc-44ac-8751-2948597de7ca None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:02.383140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1178/2369] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:16:02.388830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce31ed-4e19-4bcd-9c9b-b4e2bc238b5e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:02.389289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce31ed-4e19-4bcd-9c9b-b4e2bc238b5e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:02.389685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce31ed-4e19-4bcd-9c9b-b4e2bc238b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:02.418370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-62ce31ed-4e19-4bcd-9c9b-b4e2bc238b5e None None] MFA Rules not processed for user `3819d2b7da64494f9ed77f670b7c23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:02.419888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-62ce31ed-4e19-4bcd-9c9b-b4e2bc238b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:02.437747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:02.493150 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1192/2370] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:02.507279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb40896-6fcc-44ac-8751-2948597de7ca None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:02.509251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6eb40896-6fcc-44ac-8751-2948597de7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:02.522809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb40896-6fcc-44ac-8751-2948597de7ca None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:02.526467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e16d17-7723-480e-96b7-74c128232f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:02.527224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16d17-7723-480e-96b7-74c128232f8f service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:02.527672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16d17-7723-480e-96b7-74c128232f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:02.527672 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e16d17-7723-480e-96b7-74c128232f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:02.535053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e16d17-7723-480e-96b7-74c128232f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:02.536602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e16d17-7723-480e-96b7-74c128232f8f service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:02.548947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1179/2371] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:02.638803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee45f-604b-41a5-a6ba-5d3b8441c44f None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:02.639366 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee45f-604b-41a5-a6ba-5d3b8441c44f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:02.639503 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cee45f-604b-41a5-a6ba-5d3b8441c44f None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:02.641557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1193/2372] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:16:02.647580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679988b-aaca-42f3-bba8-ac777971c8c7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:02.647863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679988b-aaca-42f3-bba8-ac777971c8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:02.648192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679988b-aaca-42f3-bba8-ac777971c8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:02.668623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b679988b-aaca-42f3-bba8-ac777971c8c7 None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:02.669832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b679988b-aaca-42f3-bba8-ac777971c8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:02.680935 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1180/2373] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:02.693173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee45f-604b-41a5-a6ba-5d3b8441c44f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:02.695465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-91cee45f-604b-41a5-a6ba-5d3b8441c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:02.711947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cee45f-604b-41a5-a6ba-5d3b8441c44f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:02.715617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abade49a-e8e2-4500-bf64-a3d1f4062b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:02.716259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade49a-e8e2-4500-bf64-a3d1f4062b17 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:02.716539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade49a-e8e2-4500-bf64-a3d1f4062b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:02.716817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abade49a-e8e2-4500-bf64-a3d1f4062b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:02.728848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abade49a-e8e2-4500-bf64-a3d1f4062b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:02.730725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abade49a-e8e2-4500-bf64-a3d1f4062b17 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:02.744443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1194/2374] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:03.041189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:03.822096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679988b-aaca-42f3-bba8-ac777971c8c7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:03.893581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679988b-aaca-42f3-bba8-ac777971c8c7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:03.898851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:03.899575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:03.899858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:03.900257 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] PATH_INFO: `/v3/users/4e453693365c4907aa4bbe8c5ad9a131` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:03.901397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e453693365c4907aa4bbe8c5ad9a131)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:03.903351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:04.135018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e453693365c4907aa4bbe8c5ad9a131'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:04.135741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e453693365c4907aa4bbe8c5ad9a131'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:04.136390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e453693365c4907aa4bbe8c5ad9a131'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:04.235848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e453693365c4907aa4bbe8c5ad9a131'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:04.244964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e453693365c4907aa4bbe8c5ad9a131'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:04.265465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1181/2375] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:16:03 2022] DELETE /identity/v3/users/4e453693365c4907aa4bbe8c5ad9a131 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:16:04.270152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:04.273377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:04.273377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:04.294847 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:04.296943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:04.369487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1195/2376] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:04.380164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:04.381826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:04.446476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308fb8f-a8a1-4eb0-b38e-6d5697e87ef6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:04.450285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:04.450907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:04.451182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:04.451451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:04.462317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:04.463937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:04.476184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1182/2377] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:04.748903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:05.061519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:05.062507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:05.092947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dbf21-9986-45eb-95db-87b8212b1e60 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:05.096118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:05.096796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:05.097124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:05.097281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] PATH_INFO: `/v3/projects/1b5b51bf55ce4f8aa137cf7ca6b50b96` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:05.098417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5b51bf55ce4f8aa137cf7ca6b50b96)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:05.100434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:05.266242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5b51bf55ce4f8aa137cf7ca6b50b96', 'request_id': 'req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:05.274241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5b51bf55ce4f8aa137cf7ca6b50b96', 'request_id': 'req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:05.365233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5b51bf55ce4f8aa137cf7ca6b50b96', 'request_id': 'req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:05.375989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] The token cache is being invalidate because project 1b5b51bf55ce4f8aa137cf7ca6b50b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:16:05.376973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:05.376973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-7ddab1a4-d6ba-47d4-85e2-42e588c0a5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:05.378446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1196/2378] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:16:05 2022] DELETE /identity/v3/projects/1b5b51bf55ce4f8aa137cf7ca6b50b96 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:16:05.422997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:06.235048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:06.286195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:06.289646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:06.302575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff001915-b3b9-4f62-87bb-b15b745d3c25 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:06.368168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:06.368823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:06.369102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:06.369375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] PATH_INFO: `/v3/users/f6684edf647e4c11b414742e8dcd71e3` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:06.370570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6684edf647e4c11b414742e8dcd71e3)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:06.372566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:06.647010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6684edf647e4c11b414742e8dcd71e3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:06.648028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6684edf647e4c11b414742e8dcd71e3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:06.648662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6684edf647e4c11b414742e8dcd71e3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:06.720906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6684edf647e4c11b414742e8dcd71e3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:06.729934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6684edf647e4c11b414742e8dcd71e3'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:06.751256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1183/2379] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:16:06 2022] DELETE /identity/v3/users/f6684edf647e4c11b414742e8dcd71e3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:16:06.755729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:06.756278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:06.756363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:06.778131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:06.779517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:06.842552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1197/2380] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:16:06.852986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:06.854420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:06.914301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a6eb-c296-41dd-9cfb-0ac0adca0b03 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:06.918153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3c3b6-79de-490b-a87d-656c69151b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:06.918827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3c3b6-79de-490b-a87d-656c69151b94 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:06.919117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3c3b6-79de-490b-a87d-656c69151b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:06.919462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3c3b6-79de-490b-a87d-656c69151b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:06.929984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3c3b6-79de-490b-a87d-656c69151b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:06.931429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3c3b6-79de-490b-a87d-656c69151b94 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:06.941980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1184/2381] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:16:07.298000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:07.470611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:07.472231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:07.490095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623cdb0-6894-4309-9c7f-670d06dff605 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:07.492371 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:07.493175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:07.493456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:07.493730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] PATH_INFO: `/v3/projects/faf7918e23f546c48abd46b58ec31e1b` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:07.494942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf7918e23f546c48abd46b58ec31e1b)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:07.497072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:07.652432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf7918e23f546c48abd46b58ec31e1b', 'request_id': 'req-a258043d-b2b6-4123-b0d4-eef25e9f979e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:07.659293 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf7918e23f546c48abd46b58ec31e1b', 'request_id': 'req-a258043d-b2b6-4123-b0d4-eef25e9f979e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:07.731615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf7918e23f546c48abd46b58ec31e1b', 'request_id': 'req-a258043d-b2b6-4123-b0d4-eef25e9f979e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:07.745086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] The token cache is being invalidate because project faf7918e23f546c48abd46b58ec31e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:16:07.745390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:07.746109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a258043d-b2b6-4123-b0d4-eef25e9f979e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:07.759281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1198/2382] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:16:07 2022] DELETE /identity/v3/projects/faf7918e23f546c48abd46b58ec31e1b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:16:07.760082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80fe0-a3b3-4aa4-b615-e9ec8571755b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:07.760082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80fe0-a3b3-4aa4-b615-e9ec8571755b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:07.760082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80fe0-a3b3-4aa4-b615-e9ec8571755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:07.776456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-b8c80fe0-a3b3-4aa4-b615-e9ec8571755b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:07.781580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b8c80fe0-a3b3-4aa4-b615-e9ec8571755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:07.829029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:07.829754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:07.830363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:07.846289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1185/2383] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:07.852392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ed5e-a4ca-4cb0-9744-91c524065543 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:07.852713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ed5e-a4ca-4cb0-9744-91c524065543 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:07.852993 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ed5e-a4ca-4cb0-9744-91c524065543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:07.853103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:07.854425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:07.858893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:07.879837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2bc6ed5e-a4ca-4cb0-9744-91c524065543 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:07.881151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2bc6ed5e-a4ca-4cb0-9744-91c524065543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:07.894059 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1186/2384] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:16:07.896000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6ed5e-a4ca-4cb0-9744-91c524065543 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:07.905278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6ed5e-a4ca-4cb0-9744-91c524065543 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:07.910193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:07.910793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:07.911071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:07.911341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:07.912036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:16:07.912324 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:07.914016 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:07.918419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1199/2385] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:16:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:07.932040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:07.934949 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1187/2386] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:16:07.935431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:07.936381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:07.952782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cb7e3-6de1-433e-a24b-027edae22fdc admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:07.961155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:07.962103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:07.962616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:07.963102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:07.964330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:07.968007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:08.022831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60497dcd-3979-4530-b224-7c5c9129b366 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:08.028333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:08.029032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:08.029321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:08.029596 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:08.039027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:08.040682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:08.049368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1200/2387] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:16:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 05:16:08.071221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1188/2388] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:16:07 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:16:08.075426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:08.086989 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8df840-a49b-4cbc-baeb-135d6b0ffd10 service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:08.152318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:08.153078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:08.153364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:08.153663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:08.154298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:08.156312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:08.263994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1201/2389] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:16:08 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:16:08.268713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:08.280673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c234ce-1287-4382-8344-093b71df98a6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:08.286427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:08.289486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:08.289486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:08.289486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:08.289486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:08.290023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:08.308881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1189/2390] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:16:08.313092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:08.327399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b080d-982b-49cf-a285-d24963929aa2 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:08.342082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d705eac-23eb-4fd4-8d69-02b29b68c6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:08.346881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705eac-23eb-4fd4-8d69-02b29b68c6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:08.346881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705eac-23eb-4fd4-8d69-02b29b68c6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:08.346881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d705eac-23eb-4fd4-8d69-02b29b68c6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:08.346881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d705eac-23eb-4fd4-8d69-02b29b68c6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:08.347421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d705eac-23eb-4fd4-8d69-02b29b68c6e8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:08.389698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1202/2391] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:16:08.390988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:08.405347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a918e7-9e47-4b18-8974-3d8d0be1b9f0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:08.415811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:08.416962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:08.417373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:08.417770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] PATH_INFO: `/v3/projects/c58c1a70edaf44d3b1671c6936452dda/users/19d1ec9ce47641d799a4999d9b0be691/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:08.441658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58c1a70edaf44d3b1671c6936452dda, user_id=19d1ec9ce47641d799a4999d9b0be691, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:08.446254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:08.563810 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1190/2392] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:16:08 2022] PUT /identity/v3/projects/c58c1a70edaf44d3b1671c6936452dda/users/19d1ec9ce47641d799a4999d9b0be691/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:16:08.566085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f7a4d-7b73-46b8-8ed5-7cf7f147a72a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:08.566982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f7a4d-7b73-46b8-8ed5-7cf7f147a72a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:08.567400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f7a4d-7b73-46b8-8ed5-7cf7f147a72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:08.605345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-317f7a4d-7b73-46b8-8ed5-7cf7f147a72a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:08.606615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-317f7a4d-7b73-46b8-8ed5-7cf7f147a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:08.642656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:08.669725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:08.714529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1203/2393] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:08.726347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:08.728759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:08.824184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931942e0-b85d-4b83-bff4-62eaf52e9672 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:08.828588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:08.829262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:08.829490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:08.829764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:08.845643 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:08.847293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:08.857639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1191/2394] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:09.738445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:10.149439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:10.396116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d180d-2518-4b5c-8c3e-1b9323f2d45d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:10.396406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d180d-2518-4b5c-8c3e-1b9323f2d45d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:10.396683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d180d-2518-4b5c-8c3e-1b9323f2d45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:10.449838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f27d180d-2518-4b5c-8c3e-1b9323f2d45d None None] MFA Rules not processed for user `19d1ec9ce47641d799a4999d9b0be691`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:10.451166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f27d180d-2518-4b5c-8c3e-1b9323f2d45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:10.542460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1204/2395] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:10.554614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:10.557789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:10.620315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443f146-e0a1-4496-8e1e-54d8a474ad99 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:10.626981 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:10.628423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:10.628706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:10.628982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:10.641347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:10.643229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:10.665713 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1192/2396] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:11.378036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:12.057521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:13.121013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8434-8141-43be-82c8-b5bcd93d9d75 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:13.121659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8434-8141-43be-82c8-b5bcd93d9d75 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:13.121902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f8434-8141-43be-82c8-b5bcd93d9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:13.154618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-447f8434-8141-43be-82c8-b5bcd93d9d75 None None] MFA Rules not processed for user `19d1ec9ce47641d799a4999d9b0be691`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:13.157571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-447f8434-8141-43be-82c8-b5bcd93d9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:13.161175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:13.174842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1205/2397] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:14.526220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:14.600323 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:15.502269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:15.869997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:17.132907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:17.195158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:17.721794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:18.406417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:18.829770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:19.708669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:19.777368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:20.343696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:20.588615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:21.064154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:21.617475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:21.878043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:22.623225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:22.975895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:23.086843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:24.371866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:25.040579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:26.012290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:26.394567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:26.811529 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:27.444747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:27.526254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:28.288386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:28.288386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:28.309984 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a9845-e776-4feb-b2dd-db9db71dcbe7 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:28.316065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:28.316926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:28.317356 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:28.317776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] PATH_INFO: `/v3/users/1b9839411b874b96a1b95faa71e3c969` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:28.319438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9839411b874b96a1b95faa71e3c969)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:28.321831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:28.614445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9839411b874b96a1b95faa71e3c969'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:28.615478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9839411b874b96a1b95faa71e3c969'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:28.616211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9839411b874b96a1b95faa71e3c969'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:28.794396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9839411b874b96a1b95faa71e3c969'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:28.795162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:28.810593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9839411b874b96a1b95faa71e3c969'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:28.832987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1193/2398] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:16:28 2022] DELETE /identity/v3/users/1b9839411b874b96a1b95faa71e3c969 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:16:28.841812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:28.841812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:28.841812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:28.857325 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:28.858531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:28.917556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1206/2399] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:28.928164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:28.929590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:28.997634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb24d5-9b9d-4c3d-a0d7-24d32ca770b6 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:29.001255 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efdaec-5208-4a30-9f24-b1303c22c073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:29.001863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efdaec-5208-4a30-9f24-b1303c22c073 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:29.002151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efdaec-5208-4a30-9f24-b1303c22c073 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:29.002439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efdaec-5208-4a30-9f24-b1303c22c073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:29.012172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efdaec-5208-4a30-9f24-b1303c22c073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:29.013793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efdaec-5208-4a30-9f24-b1303c22c073 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:29.029380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1194/2400] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:29.599318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:29.599318 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:29.611113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53788020-cebf-4c74-a37c-f9263e294dae None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:29.625574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:29.626440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:29.626440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:29.626440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:29.626440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] PATH_INFO: `/v3/projects/0e15fcef623b4a8390f85117381f54e7` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:29.626936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e15fcef623b4a8390f85117381f54e7)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:29.627998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:29.748573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e15fcef623b4a8390f85117381f54e7', 'request_id': 'req-16195809-c038-4f67-a200-d972a67c76bd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:29.755406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e15fcef623b4a8390f85117381f54e7', 'request_id': 'req-16195809-c038-4f67-a200-d972a67c76bd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:29.845370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e15fcef623b4a8390f85117381f54e7', 'request_id': 'req-16195809-c038-4f67-a200-d972a67c76bd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:29.856310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] The token cache is being invalidate because project 0e15fcef623b4a8390f85117381f54e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:16:29.856606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:29.857255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:16:29.858761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1207/2401] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:16:29 2022] DELETE /identity/v3/projects/0e15fcef623b4a8390f85117381f54e7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:16:30.219384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf641ee-55a8-4c60-b0ed-9ebf4470efad None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:30.219835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf641ee-55a8-4c60-b0ed-9ebf4470efad None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:30.220327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf641ee-55a8-4c60-b0ed-9ebf4470efad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:30.240508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5bf641ee-55a8-4c60-b0ed-9ebf4470efad None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:30.241716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5bf641ee-55a8-4c60-b0ed-9ebf4470efad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:30.300434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1195/2402] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 25 05:16:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:30.313743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:30.314580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:30.361845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:30.391209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16195809-c038-4f67-a200-d972a67c76bd admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:30.396381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:30.396995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:30.397273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:30.397545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:30.406807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:30.408449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:30.416574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1208/2403] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:16:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 05:16:31.863399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:31.926154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:33.644998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:33.644998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:33.645616 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:33.667521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] MFA Rules not processed for user `624edd17ef8040538a16bd302851f93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:33.673460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:33.749674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1196/2404] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:33.794613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:33.857150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:34.353501 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:35.570138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:36.234020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:37.126754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:37.246806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:38.823423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:38.908445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:39.725612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:40.177277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:41.171361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:41.400561 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:41.406031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:41.407675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:41.486651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200ff56-74f5-404c-8f81-a0d73325b3be service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:41.490934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552208d7-66d6-4eb4-94c1-656965938b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:41.491557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552208d7-66d6-4eb4-94c1-656965938b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:41.491839 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552208d7-66d6-4eb4-94c1-656965938b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:41.492175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552208d7-66d6-4eb4-94c1-656965938b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:41.494890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-552208d7-66d6-4eb4-94c1-656965938b66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:41.573918 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552208d7-66d6-4eb4-94c1-656965938b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:41.575278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552208d7-66d6-4eb4-94c1-656965938b66 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:41.588033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1209/2405] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:42.051703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:42.462514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:42.703074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:42.783206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:43.176936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:43.263385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:43.875358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.000178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.217532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.317292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.474640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.502709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.657145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.719876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.817409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:44.875135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:45.045445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:45.079893 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:45.326136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:45.616386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:16:45.618766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:45.680541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:45.706765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb54fca-f2f5-443a-8271-9083a8450494 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:16:45.712344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203f0d9-f0d1-4199-b5e3-11a0e724f346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:16:45.713115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f0d9-f0d1-4199-b5e3-11a0e724f346 service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:45.713450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f0d9-f0d1-4199-b5e3-11a0e724f346 service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:45.713725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203f0d9-f0d1-4199-b5e3-11a0e724f346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:45.716246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7203f0d9-f0d1-4199-b5e3-11a0e724f346 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:45.729110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203f0d9-f0d1-4199-b5e3-11a0e724f346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:16:45.730924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203f0d9-f0d1-4199-b5e3-11a0e724f346 service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:16:45.744833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1197/2406] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:16:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:16:45.931195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:46.245534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:46.382849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:46.442113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:INSERT=3,keystone:DELETE=14,keystone:SELECT=83 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:46.902636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:46.930902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:47.354621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:47.794050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:48.753940 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:48.936942 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:49.496901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:49.696980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:49.777333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:50.908687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:50.954848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:51.485957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:51.548731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:51.685954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:51.991108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:16:51.991742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:16:51.992071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:16:52.012030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] MFA Rules not processed for user `e8776ca5fe264cee904f8fab1a16a5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:16:52.013204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:16:52.069415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1210/2407] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:16:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:16:52.125924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:52.473837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:52.560049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:52.703367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:02.371210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60846c-34d6-4ca7-933d-a21abfb4e9c7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:02.371754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60846c-34d6-4ca7-933d-a21abfb4e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:02.371754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60846c-34d6-4ca7-933d-a21abfb4e9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:02.391971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6f60846c-34d6-4ca7-933d-a21abfb4e9c7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:02.393170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6f60846c-34d6-4ca7-933d-a21abfb4e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:02.436141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:02.454370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1198/2408] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:02.468763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:17:02.470904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:02.547446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f2de8-0ac6-4cc0-a726-30963475ec0c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:17:02.553200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:17:02.553944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:02.554077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:02.554350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:02.562921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:17:02.564779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:17:02.580033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1211/2409] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:17:07.520562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d071-afc5-4dc9-ab40-9cae83a6f70e None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:07.521114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d071-afc5-4dc9-ab40-9cae83a6f70e None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:07.521212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337d071-afc5-4dc9-ab40-9cae83a6f70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:07.542421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5337d071-afc5-4dc9-ab40-9cae83a6f70e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:07.543648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5337d071-afc5-4dc9-ab40-9cae83a6f70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:07.552502 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1199/2410] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:07.566800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:17:07.568899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:07.583925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597ee9-d88e-4b06-a4a3-801e7231c703 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:17:07.589614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:17:07.590223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:07.590506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:07.590781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:07.602227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:17:07.604686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:17:07.617000 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1212/2411] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:17:12.056884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c79fc-eb28-41b3-a31d-c31cbbab3022 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:12.057406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c79fc-eb28-41b3-a31d-c31cbbab3022 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:12.057505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c79fc-eb28-41b3-a31d-c31cbbab3022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:12.077268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-948c79fc-eb28-41b3-a31d-c31cbbab3022 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:12.078470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-948c79fc-eb28-41b3-a31d-c31cbbab3022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:12.087110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1200/2412] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:12.105096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:17:12.116905 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40684d3d-d1eb-4b3b-a15a-eb989bda23bc service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:17:12.122388 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:17:12.122975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:12.123249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:12.123516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:12.132894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:17:12.135676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:17:12.146126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1213/2413] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:17:15.936591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a9d1-f524-449b-a91b-b2e4f3330dfc None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:15.937568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a9d1-f524-449b-a91b-b2e4f3330dfc None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:15.937568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a9d1-f524-449b-a91b-b2e4f3330dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:15.957623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9cc2a9d1-f524-449b-a91b-b2e4f3330dfc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:15.959001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9cc2a9d1-f524-449b-a91b-b2e4f3330dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:15.967311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1201/2414] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:15.989190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:17:16.000510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e74b2f-a2eb-43c1-a931-e979fb6d19fd service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:17:16.006855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:17:16.007445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:16.007726 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:16.008052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:16.016193 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:17:16.018014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:17:16.027419 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1214/2415] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:17:20.222601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fe5f-d6c4-4fd9-a5e0-df92a88b91da None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:20.223120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fe5f-d6c4-4fd9-a5e0-df92a88b91da None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:20.223226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fe5f-d6c4-4fd9-a5e0-df92a88b91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:20.242542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c950fe5f-d6c4-4fd9-a5e0-df92a88b91da None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:20.243759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c950fe5f-d6c4-4fd9-a5e0-df92a88b91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:20.251944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1202/2416] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:20.306077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:17:20.317950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0497f7-d77a-450d-8c4a-6824a3ab82ce service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:17:20.323553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:17:20.324200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:20.324487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:20.324766 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:20.332950 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:17:20.334581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:17:20.344182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1215/2417] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:17:24.559542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c7f8a-5b48-48a6-868e-99b3842239ef None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:24.560045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c7f8a-5b48-48a6-868e-99b3842239ef None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:24.560150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c7f8a-5b48-48a6-868e-99b3842239ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:24.579265 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-321c7f8a-5b48-48a6-868e-99b3842239ef None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:24.580602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-321c7f8a-5b48-48a6-868e-99b3842239ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:24.588818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1203/2418] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:24.607706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:17:24.613722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=72 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:24.620886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0ed0f-db85-4c63-8d22-fe3c64c6fdc7 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:17:24.627539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bda1-a958-4d30-9d39-503b93f171e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:17:24.628208 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bda1-a958-4d30-9d39-503b93f171e3 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:24.628489 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bda1-a958-4d30-9d39-503b93f171e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:24.628763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bda1-a958-4d30-9d39-503b93f171e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:24.637633 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1bda1-a958-4d30-9d39-503b93f171e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:17:24.639259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1bda1-a958-4d30-9d39-503b93f171e3 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:17:24.649500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1216/2419] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:17:34.574056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=21 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:34.645126 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:35.014034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a10da-1097-45de-8415-f52fdbe969b4 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:35.014391 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a10da-1097-45de-8415-f52fdbe969b4 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:35.014670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a10da-1097-45de-8415-f52fdbe969b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:35.035383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-898a10da-1097-45de-8415-f52fdbe969b4 None None] MFA Rules not processed for user `86fd818c1f894c388de9ca49c39a8cde`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:35.036679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-898a10da-1097-45de-8415-f52fdbe969b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:35.093675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1204/2420] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:17:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:44.668974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f534-0317-404e-b720-221b279c6043 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:17:44.669492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f534-0317-404e-b720-221b279c6043 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:17:44.669601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f534-0317-404e-b720-221b279c6043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:17:44.690728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b0b0f534-0317-404e-b720-221b279c6043 None None] MFA Rules not processed for user `19d1ec9ce47641d799a4999d9b0be691`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:17:44.691965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b0b0f534-0317-404e-b720-221b279c6043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:17:44.748166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1217/2421] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:17:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:17:45.086880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=25 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:54.741790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=25 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:02.582144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4acab-9589-4e4f-be3e-69051fffe716 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:02.585592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4acab-9589-4e4f-be3e-69051fffe716 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:02.585592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4acab-9589-4e4f-be3e-69051fffe716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:02.604168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-daa4acab-9589-4e4f-be3e-69051fffe716 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:02.605483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-daa4acab-9589-4e4f-be3e-69051fffe716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:02.616194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1205/2422] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:02.656135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0f534-0317-404e-b720-221b279c6043 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:02.668984 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0f534-0317-404e-b720-221b279c6043 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:02.674664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:02.675381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:02.675527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:02.675781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:02.684529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:02.686164 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:02.696597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1218/2423] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:18:08.059144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a30dc-8570-485c-8607-fe2316a2d11f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:08.059737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a30dc-8570-485c-8607-fe2316a2d11f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:08.059832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a30dc-8570-485c-8607-fe2316a2d11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:08.079791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-408a30dc-8570-485c-8607-fe2316a2d11f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:08.081037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-408a30dc-8570-485c-8607-fe2316a2d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:08.090305 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1206/2424] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:08.105770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:08.117201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbabe7-89da-4318-a620-585a63db387b service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:08.122644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:08.123238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:08.123515 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:08.123785 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:08.132987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:08.134811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:08.145226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1219/2425] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:18:11.016950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398000a7-8e6a-4b99-9ba9-1e632552b3f8 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:11.016950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398000a7-8e6a-4b99-9ba9-1e632552b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:11.016950 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398000a7-8e6a-4b99-9ba9-1e632552b3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:11.024248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-398000a7-8e6a-4b99-9ba9-1e632552b3f8 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:11.025580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-398000a7-8e6a-4b99-9ba9-1e632552b3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:11.038846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1207/2426] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:11.074175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:11.086481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683117f-f878-403a-9025-d0f5d1fbdf61 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:11.092129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e94682-4933-43bf-bda4-0b56e18be83d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:11.092719 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e94682-4933-43bf-bda4-0b56e18be83d service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:11.094907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e94682-4933-43bf-bda4-0b56e18be83d service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:11.094907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e94682-4933-43bf-bda4-0b56e18be83d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:11.101525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e94682-4933-43bf-bda4-0b56e18be83d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:11.103103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e94682-4933-43bf-bda4-0b56e18be83d service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:11.112470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1220/2427] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:18:13.925114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb77cd8-e84e-4df5-a00c-f6a05b88dd34 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:13.925604 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb77cd8-e84e-4df5-a00c-f6a05b88dd34 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:13.925735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb77cd8-e84e-4df5-a00c-f6a05b88dd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:13.946585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4bb77cd8-e84e-4df5-a00c-f6a05b88dd34 None None] MFA Rules not processed for user `e8776ca5fe264cee904f8fab1a16a5f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:13.947819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4bb77cd8-e84e-4df5-a00c-f6a05b88dd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:13.955070 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1208/2428] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:18:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:15.261842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340909-6ca0-4472-89ba-d6f63d8a20f0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:15.262307 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340909-6ca0-4472-89ba-d6f63d8a20f0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:15.262404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7340909-6ca0-4472-89ba-d6f63d8a20f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:15.281720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e7340909-6ca0-4472-89ba-d6f63d8a20f0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:15.282910 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e7340909-6ca0-4472-89ba-d6f63d8a20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:15.291446 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1221/2429] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:18:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:15.317079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb77cd8-e84e-4df5-a00c-f6a05b88dd34 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:15.330692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb77cd8-e84e-4df5-a00c-f6a05b88dd34 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:15.336980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177083ea-b269-4c20-8fa3-efd4f5cf6129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:15.337592 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177083ea-b269-4c20-8fa3-efd4f5cf6129 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:15.337867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177083ea-b269-4c20-8fa3-efd4f5cf6129 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:15.338138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177083ea-b269-4c20-8fa3-efd4f5cf6129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:15.346850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177083ea-b269-4c20-8fa3-efd4f5cf6129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:15.349115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177083ea-b269-4c20-8fa3-efd4f5cf6129 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:15.358327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1209/2430] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:18:17.497947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f73f16-2ce4-4f5c-9c4c-2e1d3dd43738 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:17.498484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f73f16-2ce4-4f5c-9c4c-2e1d3dd43738 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:17.498581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f73f16-2ce4-4f5c-9c4c-2e1d3dd43738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:17.520800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f4f73f16-2ce4-4f5c-9c4c-2e1d3dd43738 None None] MFA Rules not processed for user `624edd17ef8040538a16bd302851f93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:17.522083 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f4f73f16-2ce4-4f5c-9c4c-2e1d3dd43738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:17.529117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1222/2431] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:18:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:19.498957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:19.499463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:19.499590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:19.519415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:19.520564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:19.529232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1210/2432] 10.222.0.55 () {58 vars in 1016 bytes} [Thu Aug 25 05:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:19.549935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f73f16-2ce4-4f5c-9c4c-2e1d3dd43738 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:19.563075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f73f16-2ce4-4f5c-9c4c-2e1d3dd43738 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:19.568603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:19.569200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:19.569688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:19.570046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:19.579459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:19.581090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:19.592552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1223/2433] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:18:29.514545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=21 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:29.587537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=30 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:42.447531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:42.449023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:42.461307 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b2882-6d1b-4970-b25f-91e5c9dc9c6d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:42.465364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:42.465983 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:42.466357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:42.466534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:42.468423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:42.483045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:42.484494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:42.496532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1211/2434] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:18:43.677569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:43.689484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cee0e4-7edf-43bd-9b4c-55ca961286e8 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:43.693118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:43.693747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:43.694027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:43.694297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:43.696196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:43.710405 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:43.713181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:43.724811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1224/2435] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:18:50.839970 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:50.851493 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e517ab8-c09c-4445-bfd4-71fa13324acd service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:50.857031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48405b4-61ec-4821-92c1-2779c65480da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:50.857625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48405b4-61ec-4821-92c1-2779c65480da service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:50.857897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48405b4-61ec-4821-92c1-2779c65480da service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:50.858163 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48405b4-61ec-4821-92c1-2779c65480da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:50.860039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a48405b4-61ec-4821-92c1-2779c65480da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:50.871514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48405b4-61ec-4821-92c1-2779c65480da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:50.873315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48405b4-61ec-4821-92c1-2779c65480da service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:50.883251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1212/2436] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:18:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:18:53.719458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=6 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:55.415722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:55.417265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:55.431123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da81dd-353d-4048-8c7c-466e3cb23bf9 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:55.436585 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:55.438026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:55.438026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:55.438026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] PATH_INFO: `/v3/users/19d1ec9ce47641d799a4999d9b0be691` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:55.440966 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d1ec9ce47641d799a4999d9b0be691)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:55.443076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:55.670252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d1ec9ce47641d799a4999d9b0be691'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:55.693516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d1ec9ce47641d799a4999d9b0be691'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:55.694364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d1ec9ce47641d799a4999d9b0be691'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:55.791195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d1ec9ce47641d799a4999d9b0be691'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:55.798706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d1ec9ce47641d799a4999d9b0be691'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:55.805348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1225/2437] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:18:55 2022] DELETE /identity/v3/users/19d1ec9ce47641d799a4999d9b0be691 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:18:56.103509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:56.104057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:56.104280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:56.120988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:56.123312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:56.129728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:18:56.131181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:56.197347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1213/2438] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:18:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:18:56.212026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b33b1c-ca51-4e56-a691-4f3e6c7a3592 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:56.217143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:56.217849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:56.218217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:56.218667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] PATH_INFO: `/v3/projects/c58c1a70edaf44d3b1671c6936452dda` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:56.219857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58c1a70edaf44d3b1671c6936452dda)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:56.221987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:56.362364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58c1a70edaf44d3b1671c6936452dda', 'request_id': 'req-2f3e22d0-5404-450e-99b3-09b4958628dd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:56.368796 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58c1a70edaf44d3b1671c6936452dda', 'request_id': 'req-2f3e22d0-5404-450e-99b3-09b4958628dd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:56.378583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:18:56.380026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:56.449148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb14e-cd37-4503-b071-d6ba7f794b9c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:18:56.459820 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58c1a70edaf44d3b1671c6936452dda', 'request_id': 'req-2f3e22d0-5404-450e-99b3-09b4958628dd'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:56.478116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] The token cache is being invalidate because project c58c1a70edaf44d3b1671c6936452dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:18:56.482498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:56.482498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:18:56.482498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1226/2439] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:18:56 2022] DELETE /identity/v3/projects/c58c1a70edaf44d3b1671c6936452dda => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:18:56.530707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:18:56.531547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:18:56.532054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:18:56.532685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:18:56.540060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:18:56.567180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:56.615492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:18:56.617587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:18:56.627160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1214/2440] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 05:19:06.474100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:06.623552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=17 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:08.154089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:08.155540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:08.214756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e22d0-5404-450e-99b3-09b4958628dd admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:08.219465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33097fe7-dd4d-4a95-bb7e-ee0274c930a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:08.220576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33097fe7-dd4d-4a95-bb7e-ee0274c930a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:08.221093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33097fe7-dd4d-4a95-bb7e-ee0274c930a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:08.221603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33097fe7-dd4d-4a95-bb7e-ee0274c930a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:08.224540 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-33097fe7-dd4d-4a95-bb7e-ee0274c930a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:08.235969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33097fe7-dd4d-4a95-bb7e-ee0274c930a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:08.237411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33097fe7-dd4d-4a95-bb7e-ee0274c930a9 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:08.246378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1227/2441] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:15.373198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:15.374595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:15.452123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0e74-9cbb-497a-a4dd-fa595f04dd4a service swift] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:15.457227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ce13d-5efb-4260-ac19-1d33e5a58f57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:15.457842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce13d-5efb-4260-ac19-1d33e5a58f57 service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:15.458143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce13d-5efb-4260-ac19-1d33e5a58f57 service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:15.458413 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce13d-5efb-4260-ac19-1d33e5a58f57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:15.461107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6f4ce13d-5efb-4260-ac19-1d33e5a58f57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:15.473858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ce13d-5efb-4260-ac19-1d33e5a58f57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:15.476256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ce13d-5efb-4260-ac19-1d33e5a58f57 service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:15.486867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1215/2442] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:16.777452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e793b-f60e-4826-b3d5-54bd865e51e6 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:16.777961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e793b-f60e-4826-b3d5-54bd865e51e6 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:16.786657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e793b-f60e-4826-b3d5-54bd865e51e6 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:16.786657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1228/2443] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:19:16.786888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77cf40-bdd7-4400-a75d-3566b534575b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:16.786888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77cf40-bdd7-4400-a75d-3566b534575b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:16.786888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77cf40-bdd7-4400-a75d-3566b534575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:16.805773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4f77cf40-bdd7-4400-a75d-3566b534575b None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:16.806996 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4f77cf40-bdd7-4400-a75d-3566b534575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:16.876036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1216/2444] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:19:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:19:16.888689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e793b-f60e-4826-b3d5-54bd865e51e6 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:16.890579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b03e793b-f60e-4826-b3d5-54bd865e51e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:16.950567 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e793b-f60e-4826-b3d5-54bd865e51e6 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:16.954301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d6d88-8054-49dc-ae9a-38716d34ad45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:16.954934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6d88-8054-49dc-ae9a-38716d34ad45 service glance] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:16.955216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6d88-8054-49dc-ae9a-38716d34ad45 service glance] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:16.955491 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d6d88-8054-49dc-ae9a-38716d34ad45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:16.966061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d6d88-8054-49dc-ae9a-38716d34ad45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:16.967524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d6d88-8054-49dc-ae9a-38716d34ad45 service glance] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:16.978225 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1229/2445] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:17.204641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145118c-e20a-4dc2-ad75-166f9c390185 None None] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:17.204924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145118c-e20a-4dc2-ad75-166f9c390185 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:17.205231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145118c-e20a-4dc2-ad75-166f9c390185 None None] PATH_INFO: `/` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:17.206587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1217/2446] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:19:17.211463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bbe5b-daaf-46f5-b9b5-3d26ec6208c1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:17.211744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bbe5b-daaf-46f5-b9b5-3d26ec6208c1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:17.212063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bbe5b-daaf-46f5-b9b5-3d26ec6208c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:17.231978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-353bbe5b-daaf-46f5-b9b5-3d26ec6208c1 None None] MFA Rules not processed for user `3819d2b7da64494f9ed77f670b7c23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:17.233181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-353bbe5b-daaf-46f5-b9b5-3d26ec6208c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:17.239879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1230/2447] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:19:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:17.252741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145118c-e20a-4dc2-ad75-166f9c390185 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:17.264121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145118c-e20a-4dc2-ad75-166f9c390185 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:17.267731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4637-c4e6-4711-9b73-96c2dc6df3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:17.268366 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4637-c4e6-4711-9b73-96c2dc6df3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:17.268645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4637-c4e6-4711-9b73-96c2dc6df3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:17.268919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4637-c4e6-4711-9b73-96c2dc6df3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:17.276246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc4637-c4e6-4711-9b73-96c2dc6df3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:17.277741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc4637-c4e6-4711-9b73-96c2dc6df3f6 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:17.286071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1218/2448] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:17.371069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae3a7d-03f7-4857-80f4-5bd1e5303325 None None] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:17.371356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae3a7d-03f7-4857-80f4-5bd1e5303325 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:17.371632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae3a7d-03f7-4857-80f4-5bd1e5303325 None None] PATH_INFO: `/` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:17.373040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1231/2449] 10.222.0.45 () {54 vars in 921 bytes} [Thu Aug 25 05:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 05:19:17.378068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:17.378345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:17.378614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:17.400627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] MFA Rules not processed for user `89cfa7e2f08741d4938a017990b8b031`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:17.401553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:17.411209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1219/2450] 10.222.0.45 () {58 vars in 1018 bytes} [Thu Aug 25 05:19:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:17.423046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae3a7d-03f7-4857-80f4-5bd1e5303325 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:17.434673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae3a7d-03f7-4857-80f4-5bd1e5303325 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:17.438510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:17.439093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:17.439367 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:17.439636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:17.449987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:17.451401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:17.462322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1232/2451] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:18.193234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:18.195326 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:18.209355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30566d-4d78-4838-bf33-f2909a2fb72c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:18.217677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66fb36-e875-495c-8557-5f59509d4ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:18.218290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66fb36-e875-495c-8557-5f59509d4ae0 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:18.218596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66fb36-e875-495c-8557-5f59509d4ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:18.219043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66fb36-e875-495c-8557-5f59509d4ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:18.221180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5d66fb36-e875-495c-8557-5f59509d4ae0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:18.282026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66fb36-e875-495c-8557-5f59509d4ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:18.283698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66fb36-e875-495c-8557-5f59509d4ae0 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:18.288661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:18.293245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1220/2452] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:21.633132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:21.634714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:21.651896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e800-e078-44e7-9821-26c027cc2e96 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:21.658981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:21.660213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:21.660662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:21.661103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:21.664819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:21.679892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:21.681933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:21.694575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1233/2453] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:24.199999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5d8b-1337-4777-9c71-b6fa3dcac244 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:24.199999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5d8b-1337-4777-9c71-b6fa3dcac244 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:24.199999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5d8b-1337-4777-9c71-b6fa3dcac244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:24.220191 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-dd7d5d8b-1337-4777-9c71-b6fa3dcac244 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:24.226098 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-dd7d5d8b-1337-4777-9c71-b6fa3dcac244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:24.228925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1221/2454] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:19:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:24.241400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:24.242841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:24.257133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a47cc-6c32-475e-97b5-bde125c1cd91 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:24.262110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:24.262697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:24.262975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:24.263245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:24.271160 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:24.273580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:24.281529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1234/2455] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:19:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:19:26.288573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5d8b-1337-4777-9c71-b6fa3dcac244 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:26.303560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5d8b-1337-4777-9c71-b6fa3dcac244 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:26.310769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66af3d-088e-4371-b406-d3dd1c3574ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:26.311724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66af3d-088e-4371-b406-d3dd1c3574ca service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:26.313519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66af3d-088e-4371-b406-d3dd1c3574ca service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:26.313519 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66af3d-088e-4371-b406-d3dd1c3574ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:26.316876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0d66af3d-088e-4371-b406-d3dd1c3574ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:26.333741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66af3d-088e-4371-b406-d3dd1c3574ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:26.336803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66af3d-088e-4371-b406-d3dd1c3574ca service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:26.359990 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1222/2456] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:34.278273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=73 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:36.344077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=9 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:39.327088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:39.339265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5f366-01cd-48bb-81ed-80ed8fb0e86f service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:39.344827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:39.347773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:39.347773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:39.347773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:39.347773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:39.360485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:39.362096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:39.374039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1235/2457] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:42.294704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9e827-507d-4f8e-9ad5-ef98321feafc None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:42.295094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9e827-507d-4f8e-9ad5-ef98321feafc None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:42.295246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9e827-507d-4f8e-9ad5-ef98321feafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:42.316601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ddb9e827-507d-4f8e-9ad5-ef98321feafc None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:42.317830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ddb9e827-507d-4f8e-9ad5-ef98321feafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:42.325918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1223/2458] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 25 05:19:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:42.338611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:42.350194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00424e63-d171-405c-b690-3692f1348ccb service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:42.355389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:42.356010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:42.356396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:42.356673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:42.364921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:42.367145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:42.375486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1236/2459] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:19:47.538236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9e827-507d-4f8e-9ad5-ef98321feafc None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:47.551818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9e827-507d-4f8e-9ad5-ef98321feafc None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:47.560938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:47.567994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:47.567994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:47.567994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:47.567994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:47.586117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:47.587748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:47.599060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1224/2460] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:47.700092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:47.701148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:47.770162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa1983-106f-46a2-979e-2eb5d8b4aa16 service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:47.775353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:47.776033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:47.776310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:47.776581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] PATH_INFO: `/v3/users/624edd17ef8040538a16bd302851f93f` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:47.777693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=624edd17ef8040538a16bd302851f93f)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:47.779612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:48.061303 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624edd17ef8040538a16bd302851f93f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.077614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624edd17ef8040538a16bd302851f93f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.077614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624edd17ef8040538a16bd302851f93f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.185166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624edd17ef8040538a16bd302851f93f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.193035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624edd17ef8040538a16bd302851f93f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.204340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1237/2461] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:19:47 2022] DELETE /identity/v3/users/624edd17ef8040538a16bd302851f93f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:48.213339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:48.226815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6049594-6079-49eb-9e93-43c09126f116 service placement] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:48.283670 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da10329-3165-470c-8bf9-d57ed5536b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:48.284306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da10329-3165-470c-8bf9-d57ed5536b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:48.284590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da10329-3165-470c-8bf9-d57ed5536b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:48.290289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da10329-3165-470c-8bf9-d57ed5536b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:48.290289 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0da10329-3165-470c-8bf9-d57ed5536b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:48.358283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da10329-3165-470c-8bf9-d57ed5536b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:48.359931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da10329-3165-470c-8bf9-d57ed5536b96 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:48.371393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1225/2462] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:48.656092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:48.657638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:48.691299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906160c-e9bc-4d35-88a6-8243199f77ef admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:48.698506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:48.699656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:48.699930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:48.700235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] PATH_INFO: `/v3/projects/f40c5b3d8b1f452a94e47d41a75729b0` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:48.701542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40c5b3d8b1f452a94e47d41a75729b0)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:48.703629 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:48.813365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:48.814717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40c5b3d8b1f452a94e47d41a75729b0', 'request_id': 'req-8a082f61-721c-4613-9f9b-382e05653813'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.820988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40c5b3d8b1f452a94e47d41a75729b0', 'request_id': 'req-8a082f61-721c-4613-9f9b-382e05653813'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.882589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40c5b3d8b1f452a94e47d41a75729b0', 'request_id': 'req-8a082f61-721c-4613-9f9b-382e05653813'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.893573 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] The token cache is being invalidate because project f40c5b3d8b1f452a94e47d41a75729b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:19:48.893862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.894510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8a082f61-721c-4613-9f9b-382e05653813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:48.896077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1238/2463] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:19:48 2022] DELETE /identity/v3/projects/f40c5b3d8b1f452a94e47d41a75729b0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:48.901865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed5cd-0d70-401f-9f8c-df46bf71f609 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:48.902382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed5cd-0d70-401f-9f8c-df46bf71f609 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:48.902479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ed5cd-0d70-401f-9f8c-df46bf71f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:48.922214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-680ed5cd-0d70-401f-9f8c-df46bf71f609 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:48.923551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-680ed5cd-0d70-401f-9f8c-df46bf71f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:48.985196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1226/2464] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:48.994302 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91a39-b293-4b96-b399-d36ae85db4fd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:48.994510 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91a39-b293-4b96-b399-d36ae85db4fd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:48.994781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c91a39-b293-4b96-b399-d36ae85db4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.017845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-52c91a39-b293-4b96-b399-d36ae85db4fd None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:49.017845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-52c91a39-b293-4b96-b399-d36ae85db4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:49.026595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1239/2465] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:49.030867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ed5cd-0d70-401f-9f8c-df46bf71f609 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:49.041720 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ed5cd-0d70-401f-9f8c-df46bf71f609 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:49.046773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:49.047462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.047746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.048028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.048702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:19:49.049007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:49.050631 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:49.064717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1227/2466] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:19:49.069202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91a39-b293-4b96-b399-d36ae85db4fd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:49.078764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c91a39-b293-4b96-b399-d36ae85db4fd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:49.084933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:49.084933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.085447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.085447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.086161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:49.088106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:49.198258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1240/2467] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:19:49 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:19:49.202125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:49.212927 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd650c17-c2fa-4bfd-824b-f389a30567dd admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:49.226027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:49.275433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:49.279704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.279704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.279704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.279704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:49.279704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:49.371707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1228/2468] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:19:49 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:19:49.372896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:49.384233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e56a1-1b5e-499e-abdc-8286793fd046 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:49.388994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:49.393934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.393934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.393934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.393934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:49.393934 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:49.402971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1241/2469] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:49.407620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:49.418015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2975a0e-e42e-4f48-b763-8149a13f7769 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:49.422752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192c519-7ca4-4ac8-bb56-123ade4406df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:49.423373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c519-7ca4-4ac8-bb56-123ade4406df admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.423633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c519-7ca4-4ac8-bb56-123ade4406df admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.423926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192c519-7ca4-4ac8-bb56-123ade4406df admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.424583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192c519-7ca4-4ac8-bb56-123ade4406df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:49.426178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192c519-7ca4-4ac8-bb56-123ade4406df admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:49.437062 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1229/2470] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:19:49.441520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:49.452115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3c75c-cf1c-400f-81e7-79f15d06fae6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:49.456700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:49.457349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.457695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.457974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] PATH_INFO: `/v3/projects/3912ed3c55de4c38a91cf48fa7d3f6db/users/654e1cdda57f4688ae3b11c43eab14e5/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.473108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3912ed3c55de4c38a91cf48fa7d3f6db, user_id=654e1cdda57f4688ae3b11c43eab14e5, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:49.475973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:49.567862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1242/2471] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:49 2022] PUT /identity/v3/projects/3912ed3c55de4c38a91cf48fa7d3f6db/users/654e1cdda57f4688ae3b11c43eab14e5/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:49.573985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e108a-d077-4367-9fe5-a129f811626b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.574295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e108a-d077-4367-9fe5-a129f811626b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.574570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e108a-d077-4367-9fe5-a129f811626b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.592947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3a9e108a-d077-4367-9fe5-a129f811626b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:49.594139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3a9e108a-d077-4367-9fe5-a129f811626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:49.653558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1230/2472] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:49.663242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:49.665108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:49.723104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed79e-a35c-4927-a290-946f3e1afff0 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:49.727036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:49.727657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:49.727964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:49.728240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:49.737291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:49.738776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:49.749206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1243/2473] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:51.375371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0e536-8b11-45b3-82fb-5d84d14b3679 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:51.375942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0e536-8b11-45b3-82fb-5d84d14b3679 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:51.375942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0e536-8b11-45b3-82fb-5d84d14b3679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:51.405088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-fcd0e536-8b11-45b3-82fb-5d84d14b3679 None None] MFA Rules not processed for user `654e1cdda57f4688ae3b11c43eab14e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:51.406303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fcd0e536-8b11-45b3-82fb-5d84d14b3679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:51.475562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1231/2474] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:51 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:51.480061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:51.490120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1f4cd-724f-4692-b01d-6627b4098c15 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:51.495070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:51.495700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:51.496151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:51.496433 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:51.497076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:51.499060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:51.597680 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1244/2475] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:19:51 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:51.602256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0e536-8b11-45b3-82fb-5d84d14b3679 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:51.612980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0e536-8b11-45b3-82fb-5d84d14b3679 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:51.639171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:51.670938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:51.671545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:51.671823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:51.672125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:51.672824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:51.674769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:51.762263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1232/2476] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:19:51 2022] POST /identity/v3/users => generated 308 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:19:51.766564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:51.777094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b94c1-d71c-4634-9ed8-ae76691e832f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:51.781735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:51.782329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:51.782605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:51.782873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:51.783508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:51.785170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:51.796296 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1245/2477] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:19:51.800470 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:51.811018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd4a8c-c303-404c-b79d-a3e1d848b6d3 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:51.815590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:51.817775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:51.817775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:51.817775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] PATH_INFO: `/v3/projects/d6a1c6328bb5476bae0cf20212be979a/users/43d3aa769fbf48ffa8c2b10c9728e2a9/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:51.831872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a1c6328bb5476bae0cf20212be979a, user_id=43d3aa769fbf48ffa8c2b10c9728e2a9, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:51.834725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:51.905494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1233/2478] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:51 2022] PUT /identity/v3/projects/d6a1c6328bb5476bae0cf20212be979a/users/43d3aa769fbf48ffa8c2b10c9728e2a9/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:51.909478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:51.920157 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774dfd0-6e8c-4327-ab7f-1fc7ef9cb917 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:51.942671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:51.967054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:51.983660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:51.984313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:51.984592 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:51.984864 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:51.985626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:51.987239 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:51.999281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1246/2479] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:52.000235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1cfcf-595a-4572-b82b-c1a5455e1917 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:52.003529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:52.004123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4db70-ef15-44c6-bd02-96f032f3ab4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:52.004728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4db70-ef15-44c6-bd02-96f032f3ab4e service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:52.005003 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4db70-ef15-44c6-bd02-96f032f3ab4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:52.005272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4db70-ef15-44c6-bd02-96f032f3ab4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:52.007653 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-88a4db70-ef15-44c6-bd02-96f032f3ab4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:52.014326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0017f-06a2-4ced-a1e0-9d193e456a77 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:52.019873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:52.020044 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4db70-ef15-44c6-bd02-96f032f3ab4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:52.020531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:52.020955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:52.021234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] PATH_INFO: `/v3/projects/d6a1c6328bb5476bae0cf20212be979a/users/43d3aa769fbf48ffa8c2b10c9728e2a9/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:52.021477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4db70-ef15-44c6-bd02-96f032f3ab4e service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:52.023391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a1c6328bb5476bae0cf20212be979a, user_id=43d3aa769fbf48ffa8c2b10c9728e2a9, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:52.026186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:52.031100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1234/2480] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:19:52.037031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1247/2481] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:52 2022] PUT /identity/v3/projects/d6a1c6328bb5476bae0cf20212be979a/users/43d3aa769fbf48ffa8c2b10c9728e2a9/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:53.323403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181cad-42c6-43e3-8d46-5618e307457a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:53.323901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181cad-42c6-43e3-8d46-5618e307457a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:53.324035 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89181cad-42c6-43e3-8d46-5618e307457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:53.355872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-89181cad-42c6-43e3-8d46-5618e307457a None None] MFA Rules not processed for user `43d3aa769fbf48ffa8c2b10c9728e2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:53.357130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-89181cad-42c6-43e3-8d46-5618e307457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:53.441211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1235/2482] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:55.026021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:55.097479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e7c00-044c-4957-8611-7248e95a8a6f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:55.097696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:55.098307 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:55.098594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:55.098869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] PATH_INFO: `/v3/users/654e1cdda57f4688ae3b11c43eab14e5` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:55.100637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654e1cdda57f4688ae3b11c43eab14e5)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:55.102740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:55.387852 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654e1cdda57f4688ae3b11c43eab14e5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:55.402566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654e1cdda57f4688ae3b11c43eab14e5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:55.402681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654e1cdda57f4688ae3b11c43eab14e5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:55.467356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654e1cdda57f4688ae3b11c43eab14e5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:55.477520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654e1cdda57f4688ae3b11c43eab14e5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:55.487608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1248/2483] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:19:55 2022] DELETE /identity/v3/users/654e1cdda57f4688ae3b11c43eab14e5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:55.863633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89181cad-42c6-43e3-8d46-5618e307457a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:55.875503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89181cad-42c6-43e3-8d46-5618e307457a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:55.900775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:55.937609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:55.938238 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:55.938836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:55.939110 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] PATH_INFO: `/v3/projects/3912ed3c55de4c38a91cf48fa7d3f6db` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:55.940297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3912ed3c55de4c38a91cf48fa7d3f6db)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:55.942229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:56.118735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3912ed3c55de4c38a91cf48fa7d3f6db', 'request_id': 'req-e98ae9f8-8545-4022-aff9-09eadfa78853'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.127530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3912ed3c55de4c38a91cf48fa7d3f6db', 'request_id': 'req-e98ae9f8-8545-4022-aff9-09eadfa78853'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.156623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:56.158233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:56.172819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04e9ff-09e6-4bdc-a37c-260355f91097 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:56.215051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:56.219215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3912ed3c55de4c38a91cf48fa7d3f6db', 'request_id': 'req-e98ae9f8-8545-4022-aff9-09eadfa78853'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.230487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:56.234434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:56.234434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:56.234434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] PATH_INFO: `/v3/users/e8776ca5fe264cee904f8fab1a16a5f6` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:56.234702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] The token cache is being invalidate because project 3912ed3c55de4c38a91cf48fa7d3f6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:19:56.234702 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.234891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8776ca5fe264cee904f8fab1a16a5f6)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:56.235011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.235199 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1236/2484] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:19:55 2022] DELETE /identity/v3/projects/3912ed3c55de4c38a91cf48fa7d3f6db => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:56.235332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:56.239103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:56.241611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:56.254154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ae9f8-8545-4022-aff9-09eadfa78853 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:56.258986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:56.264419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:56.264419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:56.264419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] PATH_INFO: `/v3/users/43d3aa769fbf48ffa8c2b10c9728e2a9` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:56.264419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d3aa769fbf48ffa8c2b10c9728e2a9)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:56.264419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:56.485938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8776ca5fe264cee904f8fab1a16a5f6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.498712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8776ca5fe264cee904f8fab1a16a5f6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.499479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8776ca5fe264cee904f8fab1a16a5f6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.513276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d3aa769fbf48ffa8c2b10c9728e2a9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.513931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d3aa769fbf48ffa8c2b10c9728e2a9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.514541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d3aa769fbf48ffa8c2b10c9728e2a9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.607550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8776ca5fe264cee904f8fab1a16a5f6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.615332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8776ca5fe264cee904f8fab1a16a5f6'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.622464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1249/2485] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:19:56 2022] DELETE /identity/v3/users/e8776ca5fe264cee904f8fab1a16a5f6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:19:56.704932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d3aa769fbf48ffa8c2b10c9728e2a9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.715219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d3aa769fbf48ffa8c2b10c9728e2a9'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:56.733417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1237/2486] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:19:56 2022] DELETE /identity/v3/users/43d3aa769fbf48ffa8c2b10c9728e2a9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:19:56.877531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:56.879022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:56.947775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acc2c1-b459-484d-a21d-00690fa27959 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.005081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.005911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.006275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.006580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] PATH_INFO: `/v3/projects/24e23f01dd38467784ef3665ddd71876` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.008177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e23f01dd38467784ef3665ddd71876)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.009140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.010645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:57.011392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.025514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b1ebc-3fb2-42a5-a6e8-092705be71b8 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.029038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:57.031186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.031779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.032080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.032359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] PATH_INFO: `/v3/projects/d6a1c6328bb5476bae0cf20212be979a` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.034040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a1c6328bb5476bae0cf20212be979a)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.036047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.055136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:57.214089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e23f01dd38467784ef3665ddd71876', 'request_id': 'req-42aafd3c-019f-4622-a441-acdf7701ced5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.220738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e23f01dd38467784ef3665ddd71876', 'request_id': 'req-42aafd3c-019f-4622-a441-acdf7701ced5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.226154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a1c6328bb5476bae0cf20212be979a', 'request_id': 'req-78167607-b1fd-4acf-a91d-9e3e4a75cd02'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.232130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a1c6328bb5476bae0cf20212be979a', 'request_id': 'req-78167607-b1fd-4acf-a91d-9e3e4a75cd02'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.298855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e23f01dd38467784ef3665ddd71876', 'request_id': 'req-42aafd3c-019f-4622-a441-acdf7701ced5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.310444 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] The token cache is being invalidate because project 24e23f01dd38467784ef3665ddd71876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:19:57.310729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.311354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-42aafd3c-019f-4622-a441-acdf7701ced5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.312887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1250/2487] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:19:56 2022] DELETE /identity/v3/projects/24e23f01dd38467784ef3665ddd71876 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:57.317470 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b0b05-8ebe-4119-be18-11c48ddbf957 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.317751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b0b05-8ebe-4119-be18-11c48ddbf957 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.318022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b0b05-8ebe-4119-be18-11c48ddbf957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.337969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-789b0b05-8ebe-4119-be18-11c48ddbf957 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:57.339153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-789b0b05-8ebe-4119-be18-11c48ddbf957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:57.397673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1251/2488] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:19:57.406101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439146-bd3b-46f8-82c9-a85a967c6de3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.406387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439146-bd3b-46f8-82c9-a85a967c6de3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.406665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439146-bd3b-46f8-82c9-a85a967c6de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.418622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a1c6328bb5476bae0cf20212be979a', 'request_id': 'req-78167607-b1fd-4acf-a91d-9e3e4a75cd02'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.426899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-76439146-bd3b-46f8-82c9-a85a967c6de3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:57.428153 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-76439146-bd3b-46f8-82c9-a85a967c6de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:57.430512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] The token cache is being invalidate because project d6a1c6328bb5476bae0cf20212be979a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:19:57.430809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.431448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-78167607-b1fd-4acf-a91d-9e3e4a75cd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:19:57.433129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1238/2489] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:19:57 2022] DELETE /identity/v3/projects/d6a1c6328bb5476bae0cf20212be979a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:57.437732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b43b-f727-42ad-8f30-3d923402027f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.438015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b43b-f727-42ad-8f30-3d923402027f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.438292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49b43b-f727-42ad-8f30-3d923402027f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.439337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1252/2490] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:19:57.440216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76439146-bd3b-46f8-82c9-a85a967c6de3 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.449458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76439146-bd3b-46f8-82c9-a85a967c6de3 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.454312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.457653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.457653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.457653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.457653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:19:57.457653 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.458177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.458300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ce49b43b-f727-42ad-8f30-3d923402027f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:57.460345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ce49b43b-f727-42ad-8f30-3d923402027f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:57.468805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1239/2491] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:19:57.472217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1253/2492] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:19:57.477462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09b4de-c3b9-4275-92d2-5bf6fea3b3ef None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.477747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09b4de-c3b9-4275-92d2-5bf6fea3b3ef None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.478026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09b4de-c3b9-4275-92d2-5bf6fea3b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.480828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.490829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990059e7-da32-46a2-b61b-c038bb8e628d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.496358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.496358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.496624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.496740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.497472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.497788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-dd09b4de-c3b9-4275-92d2-5bf6fea3b3ef None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:57.498991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-dd09b4de-c3b9-4275-92d2-5bf6fea3b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:57.499356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.507584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1240/2493] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:57.511727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09b4de-c3b9-4275-92d2-5bf6fea3b3ef None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.522429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09b4de-c3b9-4275-92d2-5bf6fea3b3ef None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.527390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.528027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.528308 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.528581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.529229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:19:57.529536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.531150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.544623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1241/2494] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:19:57.559476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.559476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdf118-a921-4b83-882a-baa532442a31 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.563968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.564570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.564849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.565124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.565818 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.567671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.593170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1254/2495] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:19:57.596983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.661833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195fed-a852-40a7-82a6-b383cbb1245c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.667235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.667836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.668151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.668427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.669050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.670998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.674783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1242/2496] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:57.676028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.679519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:57.738687 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95227f-39e5-4d2a-a999-5302f2bfc810 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.743716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.744353 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.744633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.744901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.745515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.747466 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.763176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1255/2497] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:57.767849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.778009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bbeb5-f2cd-4e7a-86fb-6484f63d8ec6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.782660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.783305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.783581 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.783849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.784523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.786106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.795954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1256/2498] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:57.807634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.817287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19080b-5443-4c71-879e-82c64ca4a5d6 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.822601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.823212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.823488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.823757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.824410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.825962 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.836774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1257/2499] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:57.840694 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.849754 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080c4a5-1a9e-40d0-a351-48f0492b2b65 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.854806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275be66-76e4-403b-9fae-a6085f5be131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.855432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275be66-76e4-403b-9fae-a6085f5be131 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.855716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275be66-76e4-403b-9fae-a6085f5be131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.856142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275be66-76e4-403b-9fae-a6085f5be131 admin admin] PATH_INFO: `/v3/projects/42d12310d5e541fe8d5eed65629109df/users/35f38a43ee6d4eca8f2d573b74d96d00/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.858999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1243/2500] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:57.862759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.871657 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275be66-76e4-403b-9fae-a6085f5be131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d12310d5e541fe8d5eed65629109df, user_id=35f38a43ee6d4eca8f2d573b74d96d00, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.873332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18eb71c-12c9-485e-9b3f-396d76b3d5a5 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.874454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275be66-76e4-403b-9fae-a6085f5be131 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.878167 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.878766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.879043 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.879311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.880001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.882301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.893031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1244/2501] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:57.897822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.907829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eed0de-12e1-49e7-a47b-50b4ce688db4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.912658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.913431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.913715 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.913992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.914638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.916301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.926696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1245/2502] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:57.931201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:57.940754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9a4e-1c53-4fd4-b0db-5cb285df8398 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:57.946403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2a637-f585-4fe1-923e-9578cc11884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:57.947055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2a637-f585-4fe1-923e-9578cc11884f admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.947335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2a637-f585-4fe1-923e-9578cc11884f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.947605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2a637-f585-4fe1-923e-9578cc11884f admin admin] PATH_INFO: `/v3/projects/50aae86aaae54e3bb636fab17db0015a/users/6476cfafb18c4d69a809b9d7c7502470/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:57.962568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2a637-f585-4fe1-923e-9578cc11884f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50aae86aaae54e3bb636fab17db0015a, user_id=6476cfafb18c4d69a809b9d7c7502470, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:57.965260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2a637-f585-4fe1-923e-9578cc11884f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:57.973643 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1258/2503] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:57 2022] PUT /identity/v3/projects/42d12310d5e541fe8d5eed65629109df/users/35f38a43ee6d4eca8f2d573b74d96d00/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:19:57.983841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77529486-2cc5-41d7-a2c0-b106927483ef None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:57.984509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77529486-2cc5-41d7-a2c0-b106927483ef None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:57.984509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77529486-2cc5-41d7-a2c0-b106927483ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.013983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-77529486-2cc5-41d7-a2c0-b106927483ef None None] MFA Rules not processed for user `35f38a43ee6d4eca8f2d573b74d96d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:58.015246 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-77529486-2cc5-41d7-a2c0-b106927483ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:58.038080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:58.043642 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1246/2504] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:57 2022] PUT /identity/v3/projects/50aae86aaae54e3bb636fab17db0015a/users/6476cfafb18c4d69a809b9d7c7502470/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:19:58.056518 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aadb7e-39a5-4e80-b24e-b809e136c7a2 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.056885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aadb7e-39a5-4e80-b24e-b809e136c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.057158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aadb7e-39a5-4e80-b24e-b809e136c7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.081728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1259/2505] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:19:58.085321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-a7aadb7e-39a5-4e80-b24e-b809e136c7a2 None None] MFA Rules not processed for user `6476cfafb18c4d69a809b9d7c7502470`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:58.086072 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77529486-2cc5-41d7-a2c0-b106927483ef None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.086760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-a7aadb7e-39a5-4e80-b24e-b809e136c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:58.150767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77529486-2cc5-41d7-a2c0-b106927483ef None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.152479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1247/2506] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:58.156622 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aadb7e-39a5-4e80-b24e-b809e136c7a2 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.190061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:58.208619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.209436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.209788 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.209964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.210578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.212640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.220207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aadb7e-39a5-4e80-b24e-b809e136c7a2 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.224962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.225603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.225875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.229421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.229421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.229421 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.334152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1260/2507] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:19:58 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:58.338257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.358078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1248/2508] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:19:58 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:58.364635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.403637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e681c-19f3-4a20-b926-9a2200fad67c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.428569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55a91-e681-4fc7-86f0-c8a20a36ce60 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.433634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.434245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.434522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.434790 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.435415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.437351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.461197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.461805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.466274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.466274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.466274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.466274 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.550828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1249/2509] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:19:58 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:58.555042 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.562775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:58.568229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff9426-b5b0-4a4f-8b6b-eff23b121a1a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.573473 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.574071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.574349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.574621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.575260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.576898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.587254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1261/2510] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:19:58 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:19:58.591132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1250/2511] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:58.592208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.592400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.602259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139290c3-0fb7-4489-be3a-bdff75092a47 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.602486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee9084-4361-4a0f-8832-1f48763795a9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.607241 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.607575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.607831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.608135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.608258 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.608413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.608540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.608800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] PATH_INFO: `/v3/projects/3762d797fa734828a6598d692d84128f/users/32cb213320194eb1aaa3ff54d9f72202/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.609047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.610768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.621449 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1262/2512] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:19:58.625689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.626918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3762d797fa734828a6598d692d84128f, user_id=32cb213320194eb1aaa3ff54d9f72202, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.629656 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.635752 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd0120-2adf-4b0c-8a53-7149ea559d45 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.640374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.641002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.641277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.641547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] PATH_INFO: `/v3/projects/7139f17c534948d19477015cd87c363b/users/7f5d97683371482fa3582ff6b4a4b184/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.656551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7139f17c534948d19477015cd87c363b, user_id=7f5d97683371482fa3582ff6b4a4b184, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.659180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.711694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1251/2513] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:58 2022] PUT /identity/v3/projects/3762d797fa734828a6598d692d84128f/users/32cb213320194eb1aaa3ff54d9f72202/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:58.715669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.734088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1263/2514] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:58 2022] PUT /identity/v3/projects/7139f17c534948d19477015cd87c363b/users/7f5d97683371482fa3582ff6b4a4b184/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:19:58.742023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.773322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:58.779069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1682a9b-b24d-4760-9a6d-cc7c56dfae95 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.805520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c3738-99fa-4c27-83c8-6ff132735161 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.810278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.810885 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.811165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.811438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.812141 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.813770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.824305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1264/2515] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:19:58.828342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.836377 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.837015 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.837347 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.837569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.838217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.838706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab0ccb-96ed-4c3e-a3fa-7a297d712dc1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.839988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.843636 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9d58d-b5cf-41d5-a3b6-9f2c0634337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.844299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d58d-b5cf-41d5-a3b6-9f2c0634337c admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.844576 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d58d-b5cf-41d5-a3b6-9f2c0634337c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.844846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9d58d-b5cf-41d5-a3b6-9f2c0634337c admin admin] PATH_INFO: `/v3/projects/7139f17c534948d19477015cd87c363b/users/7f5d97683371482fa3582ff6b4a4b184/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.846930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d58d-b5cf-41d5-a3b6-9f2c0634337c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7139f17c534948d19477015cd87c363b, user_id=7f5d97683371482fa3582ff6b4a4b184, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.850492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1252/2516] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:19:58.850818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9d58d-b5cf-41d5-a3b6-9f2c0634337c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.854931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.862028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1265/2517] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:58 2022] PUT /identity/v3/projects/7139f17c534948d19477015cd87c363b/users/7f5d97683371482fa3582ff6b4a4b184/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:19:58.864902 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70e4d4-ce9f-44d6-b7d8-7f51c04ef522 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:58.874100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.874389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.874663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.903281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] MFA Rules not processed for user `7f5d97683371482fa3582ff6b4a4b184`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:58.904541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:58.921866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b86ffc-cc4e-4b17-8543-8800b3779657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:58.922525 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86ffc-cc4e-4b17-8543-8800b3779657 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.922806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86ffc-cc4e-4b17-8543-8800b3779657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.923211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b86ffc-cc4e-4b17-8543-8800b3779657 admin admin] PATH_INFO: `/v3/projects/3762d797fa734828a6598d692d84128f/users/32cb213320194eb1aaa3ff54d9f72202/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.925181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86ffc-cc4e-4b17-8543-8800b3779657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3762d797fa734828a6598d692d84128f, user_id=32cb213320194eb1aaa3ff54d9f72202, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:58.927888 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b86ffc-cc4e-4b17-8543-8800b3779657 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:58.938431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1253/2518] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:19:58 2022] PUT /identity/v3/projects/3762d797fa734828a6598d692d84128f/users/32cb213320194eb1aaa3ff54d9f72202/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:19:58.948822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:58.949114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:58.949434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:58.965471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:58.976909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1266/2519] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:19:58.980636 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] MFA Rules not processed for user `32cb213320194eb1aaa3ff54d9f72202`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:19:58.981876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:58.987733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:58.989133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:59.048972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6fd74-52f4-4bc1-b9a9-9ee5c1bbdd15 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:59.053744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1254/2520] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:19:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:19:59.066109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:59.067588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:19:59.100357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:59.100886 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:59.101171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:59.101437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:59.105532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:59.126524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1c3d5-0204-4f02-b164-a74ce62db95c None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:59.130223 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:59.130931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:59.131819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:59.132127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:59.141743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:59.143225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:59.153149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1255/2521] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:19:59.160172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:59.161648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:59.172163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1267/2522] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:19:59.268850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:19:59.278077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf3736-ba25-4110-b96b-ce4d12a6e026 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:19:59.282113 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:19:59.282838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:19:59.283119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:19:59.283389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:19:59.342403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:19:59.343990 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:19:59.353919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1256/2523] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:19:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:02.638310 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:02.648129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e1b6-17ae-4a5c-a9cc-37570ae0014a service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:02.651762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14d10b-2ed3-4397-9529-eabb0b8d9b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:02.652397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14d10b-2ed3-4397-9529-eabb0b8d9b16 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:02.652675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14d10b-2ed3-4397-9529-eabb0b8d9b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:02.652946 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14d10b-2ed3-4397-9529-eabb0b8d9b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:02.716992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14d10b-2ed3-4397-9529-eabb0b8d9b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:02.718437 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14d10b-2ed3-4397-9529-eabb0b8d9b16 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:02.728683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1268/2524] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:04.610440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:04.644084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:04.671078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e23c2-fab8-44d6-ae3c-dc5579d6d6e1 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:04.676137 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:04.676794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:04.677074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:04.677348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] PATH_INFO: `/v3/users/6476cfafb18c4d69a809b9d7c7502470` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:04.679028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6476cfafb18c4d69a809b9d7c7502470)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:04.681020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:04.829089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6476cfafb18c4d69a809b9d7c7502470'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:04.829745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6476cfafb18c4d69a809b9d7c7502470'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:04.830468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6476cfafb18c4d69a809b9d7c7502470'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:04.904660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6476cfafb18c4d69a809b9d7c7502470'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:04.913969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6476cfafb18c4d69a809b9d7c7502470'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:04.930527 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1257/2525] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:04 2022] DELETE /identity/v3/users/6476cfafb18c4d69a809b9d7c7502470 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:04.935059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:04.935557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:04.935677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:04.954220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:04.955427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:05.018088 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1269/2526] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:05.029180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:05.030605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:05.088414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c08a-cd00-4e59-87cf-45b82cdd51a7 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:05.092155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:05.092765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:05.093050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:05.093415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:05.103524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:05.104932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:05.115064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1258/2527] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:05.553048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:05.554071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:05.566496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27586bd-c6d2-4d5f-b869-59e1c6d4cc3a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:05.572132 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:05.572770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:05.573048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:05.573321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] PATH_INFO: `/v3/projects/50aae86aaae54e3bb636fab17db0015a` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:05.574454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50aae86aaae54e3bb636fab17db0015a)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:05.576416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:05.672306 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:05.682488 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50aae86aaae54e3bb636fab17db0015a', 'request_id': 'req-32fcc741-bc0f-4299-891c-6947ef680b7e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:05.688829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50aae86aaae54e3bb636fab17db0015a', 'request_id': 'req-32fcc741-bc0f-4299-891c-6947ef680b7e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:05.744235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50aae86aaae54e3bb636fab17db0015a', 'request_id': 'req-32fcc741-bc0f-4299-891c-6947ef680b7e'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:05.754988 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] The token cache is being invalidate because project 50aae86aaae54e3bb636fab17db0015a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:05.766640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:05.766640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:05.766640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1270/2528] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:05 2022] DELETE /identity/v3/projects/50aae86aaae54e3bb636fab17db0015a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:05.766929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:05.772206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e5330-4488-422c-8e44-f2a7c1d54e7f service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:05.822375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:05.829136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:05.829767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:05.830047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:05.830319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] PATH_INFO: `/v3/users/32cb213320194eb1aaa3ff54d9f72202` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:05.831444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32cb213320194eb1aaa3ff54d9f72202)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:05.833402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:06.119440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32cb213320194eb1aaa3ff54d9f72202'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.120174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32cb213320194eb1aaa3ff54d9f72202'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.120791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32cb213320194eb1aaa3ff54d9f72202'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.225095 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32cb213320194eb1aaa3ff54d9f72202'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.233931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7cdf5655-22ce-4d01-a040-d92d15278ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32cb213320194eb1aaa3ff54d9f72202'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.253169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1259/2529] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:05 2022] DELETE /identity/v3/users/32cb213320194eb1aaa3ff54d9f72202 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:06.729173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:06.730651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:06.745026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcc741-bc0f-4299-891c-6947ef680b7e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:06.804809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:06.805378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:06.805660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:06.805944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] PATH_INFO: `/v3/projects/3762d797fa734828a6598d692d84128f` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:06.807107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3762d797fa734828a6598d692d84128f)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:06.809069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:06.888644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3762d797fa734828a6598d692d84128f', 'request_id': 'req-92e9e656-ae54-41e5-a511-1c80f9097051'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.894833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3762d797fa734828a6598d692d84128f', 'request_id': 'req-92e9e656-ae54-41e5-a511-1c80f9097051'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.965651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3762d797fa734828a6598d692d84128f', 'request_id': 'req-92e9e656-ae54-41e5-a511-1c80f9097051'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.977248 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] The token cache is being invalidate because project 3762d797fa734828a6598d692d84128f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:06.977537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.978175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-92e9e656-ae54-41e5-a511-1c80f9097051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:06.979691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1271/2530] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:06 2022] DELETE /identity/v3/projects/3762d797fa734828a6598d692d84128f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:06.984718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38781-6c8a-4c29-8e27-a6a3530cf68b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:06.985186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38781-6c8a-4c29-8e27-a6a3530cf68b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:06.985301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d38781-6c8a-4c29-8e27-a6a3530cf68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.005937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-d2d38781-6c8a-4c29-8e27-a6a3530cf68b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:07.007142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d2d38781-6c8a-4c29-8e27-a6a3530cf68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:07.065997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1260/2531] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:07.074134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cebbc9-8a50-4ee2-b2b0-b2e19678802d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.074429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cebbc9-8a50-4ee2-b2b0-b2e19678802d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.074700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cebbc9-8a50-4ee2-b2b0-b2e19678802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.095089 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-45cebbc9-8a50-4ee2-b2b0-b2e19678802d None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:07.098615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-45cebbc9-8a50-4ee2-b2b0-b2e19678802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:07.105107 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1272/2532] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:07.109373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d38781-6c8a-4c29-8e27-a6a3530cf68b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:07.119839 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d38781-6c8a-4c29-8e27-a6a3530cf68b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:07.124576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:07.125182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.125464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.125740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.126414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:07.126717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:07.128547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:07.140464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1261/2533] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:07.144807 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cebbc9-8a50-4ee2-b2b0-b2e19678802d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:07.154737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cebbc9-8a50-4ee2-b2b0-b2e19678802d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:07.159426 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:07.160063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.160336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.160607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.161237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:07.163827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:07.250814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1273/2534] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:07 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:07.254990 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:07.269881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ae06a-bcd9-45a3-a0cc-1f1944220fc5 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:07.327937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:07.328474 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.328749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.329017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.329686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:07.331618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:07.340514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:07.447537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1262/2535] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:07 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:07.451344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:07.461513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56367246-4ba3-4ce2-9aeb-fb9f5618df42 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:07.466113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:07.466712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.466987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.467255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.467897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:07.469523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:07.480034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1274/2536] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:07.484666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:07.494708 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356238ad-c7ae-44d3-ba2d-7cc6aaa3c838 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:07.499317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e623722-a44f-47d8-861e-3baa775a9f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:07.499929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e623722-a44f-47d8-861e-3baa775a9f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.500207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e623722-a44f-47d8-861e-3baa775a9f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.500478 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e623722-a44f-47d8-861e-3baa775a9f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.501115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e623722-a44f-47d8-861e-3baa775a9f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:07.502712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e623722-a44f-47d8-861e-3baa775a9f0b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:07.514755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1263/2537] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:07.518833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:07.528774 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e2d90-bc14-4a70-8261-22f32d8077ff admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:07.533363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:07.534001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.534279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.534550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] PATH_INFO: `/v3/projects/f50226745b6844f291c6f7a20ea2e723/users/b988aa5164fb416ab01aaba448b99982/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.546018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:07.550080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50226745b6844f291c6f7a20ea2e723, user_id=b988aa5164fb416ab01aaba448b99982, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:07.553609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:07.689431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1275/2538] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:07 2022] PUT /identity/v3/projects/f50226745b6844f291c6f7a20ea2e723/users/b988aa5164fb416ab01aaba448b99982/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:07.701054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15378b7-150d-4a58-b790-d46478e0b466 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.708068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15378b7-150d-4a58-b790-d46478e0b466 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.708068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15378b7-150d-4a58-b790-d46478e0b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.729371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-c15378b7-150d-4a58-b790-d46478e0b466 None None] MFA Rules not processed for user `b988aa5164fb416ab01aaba448b99982`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:07.730599 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-c15378b7-150d-4a58-b790-d46478e0b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:07.794014 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1264/2539] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:07.798518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:07.861370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90e15-ef46-46ae-8c53-6085f4af3214 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:07.866821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:07.867427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:07.867705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:07.868009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:07.868640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:07.870557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.014423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1276/2540] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:07 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:08.014562 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15378b7-150d-4a58-b790-d46478e0b466 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:08.024751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15378b7-150d-4a58-b790-d46478e0b466 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:08.082104 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:08.082803 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.083107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.083387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.084607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:08.086611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.201895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1265/2541] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:08 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:08.206025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:08.217324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8a4c8-c38f-4dca-984b-fe0a88a20335 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:08.222166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:08.222800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.223130 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.223590 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.224985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:08.226848 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.237530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1277/2542] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:08.242750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:08.252931 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d6362-7ed8-433b-8a8d-b079e90b5db7 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:08.257901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:08.258586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.258863 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.259134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] PATH_INFO: `/v3/projects/6edff9b0ee844f14af7b99e003c6e380/users/c980d0ad0119469082c5e226a7b25fa7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.274402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edff9b0ee844f14af7b99e003c6e380, user_id=c980d0ad0119469082c5e226a7b25fa7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:08.277192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.361052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1266/2543] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:08 2022] PUT /identity/v3/projects/6edff9b0ee844f14af7b99e003c6e380/users/c980d0ad0119469082c5e226a7b25fa7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:08.365925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:08.376108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d41fe-6953-4f05-a2e3-9aff2acbbedd admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:08.433940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf755fe-77c2-4afb-8d0b-d6ee8c3ff00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:08.434546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf755fe-77c2-4afb-8d0b-d6ee8c3ff00b admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.434829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf755fe-77c2-4afb-8d0b-d6ee8c3ff00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.435105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf755fe-77c2-4afb-8d0b-d6ee8c3ff00b admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.435746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf755fe-77c2-4afb-8d0b-d6ee8c3ff00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:08.437401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf755fe-77c2-4afb-8d0b-d6ee8c3ff00b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.447217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1278/2544] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:08.451340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:08.461918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca1e89-9b19-4cd9-ab63-e691c48e4979 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:08.466686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:08.467321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.467595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.467864 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] PATH_INFO: `/v3/projects/6edff9b0ee844f14af7b99e003c6e380/users/c980d0ad0119469082c5e226a7b25fa7/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.469980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edff9b0ee844f14af7b99e003c6e380, user_id=c980d0ad0119469082c5e226a7b25fa7, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:08.472638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.483499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1267/2545] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:08 2022] PUT /identity/v3/projects/6edff9b0ee844f14af7b99e003c6e380/users/c980d0ad0119469082c5e226a7b25fa7/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:08.494481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916cc1-7dd4-4d91-9c2d-e74d859653f4 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.494770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916cc1-7dd4-4d91-9c2d-e74d859653f4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.495048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d916cc1-7dd4-4d91-9c2d-e74d859653f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.524396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3d916cc1-7dd4-4d91-9c2d-e74d859653f4 None None] MFA Rules not processed for user `c980d0ad0119469082c5e226a7b25fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:08.525670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3d916cc1-7dd4-4d91-9c2d-e74d859653f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:08.571742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:08.594408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1279/2546] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:08.606508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:08.608213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:08.635540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:08.667479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8948949-73e3-4d42-84dd-b9c0f48e2a92 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:08.671266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:08.671868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.672175 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.672445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.682508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:08.684027 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.694536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1268/2547] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:08.908189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916cc1-7dd4-4d91-9c2d-e74d859653f4 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:08.918294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d916cc1-7dd4-4d91-9c2d-e74d859653f4 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:08.922212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f566a78-9402-4a23-85dc-af874613e1dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:08.922839 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566a78-9402-4a23-85dc-af874613e1dd service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:08.923117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566a78-9402-4a23-85dc-af874613e1dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:08.923387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f566a78-9402-4a23-85dc-af874613e1dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:08.982410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f566a78-9402-4a23-85dc-af874613e1dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:08.983951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f566a78-9402-4a23-85dc-af874613e1dd service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:08.993859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1280/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:15.717724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:15.783288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7962d-f73d-427f-8658-bcaf35161d0d service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:15.788254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:15.788886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:15.789182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:15.789452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] PATH_INFO: `/v3/users/b988aa5164fb416ab01aaba448b99982` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:15.790576 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b988aa5164fb416ab01aaba448b99982)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:15.792704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:15.981262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b988aa5164fb416ab01aaba448b99982'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:15.981928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b988aa5164fb416ab01aaba448b99982'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:15.982540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b988aa5164fb416ab01aaba448b99982'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:16.064906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b988aa5164fb416ab01aaba448b99982'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:16.072965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b988aa5164fb416ab01aaba448b99982'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:16.090682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1269/2549] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:15 2022] DELETE /identity/v3/users/b988aa5164fb416ab01aaba448b99982 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:16.095298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:16.095760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:16.099090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:16.115532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:16.116921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:16.176638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1281/2550] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:16.186787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:16.188267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:16.236769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:16.247703 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7731cc-b946-48ba-bd7f-2023dc08ff57 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:16.251412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:16.252042 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:16.252319 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:16.252584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:16.262078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:16.263624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:16.273221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1270/2551] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:16.703373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:16.703373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:16.718494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873a1f-91c6-4d0c-9bf7-49feee5b46c6 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:16.723831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:16.724759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:16.725077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:16.725445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] PATH_INFO: `/v3/projects/f50226745b6844f291c6f7a20ea2e723` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:16.726732 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50226745b6844f291c6f7a20ea2e723)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:16.732478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:16.877170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50226745b6844f291c6f7a20ea2e723', 'request_id': 'req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:16.883417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50226745b6844f291c6f7a20ea2e723', 'request_id': 'req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:16.996627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50226745b6844f291c6f7a20ea2e723', 'request_id': 'req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.007817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] The token cache is being invalidate because project f50226745b6844f291c6f7a20ea2e723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:17.008138 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.008780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.010286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1282/2552] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:16 2022] DELETE /identity/v3/projects/f50226745b6844f291c6f7a20ea2e723 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:17.014438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:17.025248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffee2e0-ba43-4c99-b809-adc141b29960 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:17.084524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:17.085166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:17.085447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:17.085723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] PATH_INFO: `/v3/users/c980d0ad0119469082c5e226a7b25fa7` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:17.086875 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c980d0ad0119469082c5e226a7b25fa7)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:17.089425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:17.343321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c980d0ad0119469082c5e226a7b25fa7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.344274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c980d0ad0119469082c5e226a7b25fa7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.344876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c980d0ad0119469082c5e226a7b25fa7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.402023 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c980d0ad0119469082c5e226a7b25fa7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.410024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-47d8513e-1fb7-4e58-b30f-317ef45f727e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c980d0ad0119469082c5e226a7b25fa7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:17.428498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1271/2553] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:17 2022] DELETE /identity/v3/users/c980d0ad0119469082c5e226a7b25fa7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:17.831619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:17.833131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:17.849625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2508f-c6e3-4488-9cfc-550fb31f50b7 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:17.854746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:17.909358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:17.909983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:17.910260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:17.910530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] PATH_INFO: `/v3/projects/6edff9b0ee844f14af7b99e003c6e380` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:17.911658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edff9b0ee844f14af7b99e003c6e380)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:17.913638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.047677 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edff9b0ee844f14af7b99e003c6e380', 'request_id': 'req-b2cee868-759e-49f7-8bf7-08cc82facf35'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.053825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edff9b0ee844f14af7b99e003c6e380', 'request_id': 'req-b2cee868-759e-49f7-8bf7-08cc82facf35'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.133326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edff9b0ee844f14af7b99e003c6e380', 'request_id': 'req-b2cee868-759e-49f7-8bf7-08cc82facf35'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.145277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] The token cache is being invalidate because project 6edff9b0ee844f14af7b99e003c6e380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:18.145569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.146233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b2cee868-759e-49f7-8bf7-08cc82facf35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.147731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1283/2554] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:17 2022] DELETE /identity/v3/projects/6edff9b0ee844f14af7b99e003c6e380 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:18.152738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f3019-1c32-4900-81dd-2421b7347496 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.153271 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f3019-1c32-4900-81dd-2421b7347496 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.153376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f3019-1c32-4900-81dd-2421b7347496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.174075 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-135f3019-1c32-4900-81dd-2421b7347496 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:18.175291 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-135f3019-1c32-4900-81dd-2421b7347496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:18.232842 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1272/2555] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:18.246045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.246329 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.246607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.266507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:18.267714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:18.275560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1284/2556] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:18.279850 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f3019-1c32-4900-81dd-2421b7347496 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.289457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f3019-1c32-4900-81dd-2421b7347496 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.294671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.295272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.295546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.295815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.296497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:18.296801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.298448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.300085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:18.311490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1273/2557] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:18.319041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.319170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.320471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:18.329242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150a1be-d9fa-4e7e-8a21-5fc2fe1c3beb admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.332429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cff755-5223-4d22-9744-23db97ed3ac1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.334772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.335365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.335646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.335926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.336569 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.337654 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.338507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.338625 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.338973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.339435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] PATH_INFO: `/v3/users/35f38a43ee6d4eca8f2d573b74d96d00` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.341244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f38a43ee6d4eca8f2d573b74d96d00)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.344352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.468224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1274/2558] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:18 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:18.470610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.538854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02b3f-93ef-4381-9cd7-0baaa4511f29 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.544454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.545145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.545344 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.545623 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.546256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.548431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.594233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f38a43ee6d4eca8f2d573b74d96d00'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.607482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f38a43ee6d4eca8f2d573b74d96d00'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.608205 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f38a43ee6d4eca8f2d573b74d96d00'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.659091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1275/2559] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:18 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:18.663208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.674451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0254c-707e-453f-88e8-36191233553e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.676143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f38a43ee6d4eca8f2d573b74d96d00'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.681418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.682828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.683116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.683445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.684142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.685811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.686958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-93e9e17f-cf85-43d2-9f56-182a5be08fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f38a43ee6d4eca8f2d573b74d96d00'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:18.693492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1285/2560] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:18 2022] DELETE /identity/v3/users/35f38a43ee6d4eca8f2d573b74d96d00 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:18.697667 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1276/2561] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:18.698079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.698486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.698818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.706022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.706532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:18.708876 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:18.719840 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:18.721176 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:18.722333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2d8c8-efa3-4029-b609-a5c075c89e2b admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.780797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.781412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.781701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.781977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.782629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.783059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1286/2562] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:18.785134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.793890 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.795323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:18.799127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1277/2563] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:18.800093 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:18.810053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c89774-9569-4cde-b8f5-89433c66c4da admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.814765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.815410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.815688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.815989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] PATH_INFO: `/v3/projects/5656d6344d094e3d8a2814e41fba5254/users/1ad7634e30294c30b2c40dee33c068f4/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.831507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5656d6344d094e3d8a2814e41fba5254, user_id=1ad7634e30294c30b2c40dee33c068f4, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.834971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.855897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb491eab-6f9f-485b-a4f3-be017d35535e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:18.859647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3755353-6d50-4379-adad-d40912b5a152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:18.860564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3755353-6d50-4379-adad-d40912b5a152 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.860849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3755353-6d50-4379-adad-d40912b5a152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.861118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3755353-6d50-4379-adad-d40912b5a152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.870921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3755353-6d50-4379-adad-d40912b5a152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:18.872611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3755353-6d50-4379-adad-d40912b5a152 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:18.882393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1287/2564] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:18.889769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1278/2565] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:18 2022] PUT /identity/v3/projects/5656d6344d094e3d8a2814e41fba5254/users/1ad7634e30294c30b2c40dee33c068f4/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:18.899981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff3f5-954c-47d8-9141-3ebfa4e91b07 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:18.900822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff3f5-954c-47d8-9141-3ebfa4e91b07 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:18.901175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ff3f5-954c-47d8-9141-3ebfa4e91b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:18.930959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-a31ff3f5-954c-47d8-9141-3ebfa4e91b07 None None] MFA Rules not processed for user `1ad7634e30294c30b2c40dee33c068f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:18.932534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a31ff3f5-954c-47d8-9141-3ebfa4e91b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:19.005949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1288/2566] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:19.011170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.037679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:19.073965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c19f-2ea8-4cbb-b588-7f0a2cac92af admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.078669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.079270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.079545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.079922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.080514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.088565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.191177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1279/2567] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:19 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:19.192745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ff3f5-954c-47d8-9141-3ebfa4e91b07 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.206030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ff3f5-954c-47d8-9141-3ebfa4e91b07 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.252120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:19.278700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.279420 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.279730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.280055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.280718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.282717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.323449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.325334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:19.350251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad8806-74d5-4df9-8d67-627997e54ae0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.356963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.357594 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.357874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.358144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] PATH_INFO: `/v3/projects/42d12310d5e541fe8d5eed65629109df` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.359322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d12310d5e541fe8d5eed65629109df)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.361306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.379773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1289/2568] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:19 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:19.383287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.394520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0a2a-fd90-481e-9dcb-79fac5c8b5ae admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.399182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.399806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.400110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.400904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.401556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.403115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.413047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1290/2569] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:19.417724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.427092 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186e8ed-dea0-4ccf-b3d6-53ba6322890d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.432112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.432623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.432897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.433165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.433776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.435432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.446328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1291/2570] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:19.450322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.460238 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db633c-7d66-42c5-911a-847a726ff5a7 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.465548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e6550-7c5f-4ac8-8ddc-1ec48f9bd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.467730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e6550-7c5f-4ac8-8ddc-1ec48f9bd6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.467730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e6550-7c5f-4ac8-8ddc-1ec48f9bd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.467730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e6550-7c5f-4ac8-8ddc-1ec48f9bd6d1 admin admin] PATH_INFO: `/v3/projects/1076b5d694ea433aa7eda41964338578/users/8885198c56a64580acdcdf8b41acf072/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.485149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e6550-7c5f-4ac8-8ddc-1ec48f9bd6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1076b5d694ea433aa7eda41964338578, user_id=8885198c56a64580acdcdf8b41acf072, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.487345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e6550-7c5f-4ac8-8ddc-1ec48f9bd6d1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.582613 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1292/2571] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:19 2022] PUT /identity/v3/projects/1076b5d694ea433aa7eda41964338578/users/8885198c56a64580acdcdf8b41acf072/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:19.592758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff104c3-4fb7-4071-a68f-da3515f043c7 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.593039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff104c3-4fb7-4071-a68f-da3515f043c7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.593312 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff104c3-4fb7-4071-a68f-da3515f043c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.616111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d12310d5e541fe8d5eed65629109df', 'request_id': 'req-be44f112-e805-4488-b3d3-e7b2c1918930'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:19.623298 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d12310d5e541fe8d5eed65629109df', 'request_id': 'req-be44f112-e805-4488-b3d3-e7b2c1918930'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:19.641607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5ff104c3-4fb7-4071-a68f-da3515f043c7 None None] MFA Rules not processed for user `8885198c56a64580acdcdf8b41acf072`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:19.642845 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5ff104c3-4fb7-4071-a68f-da3515f043c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:19.716831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d12310d5e541fe8d5eed65629109df', 'request_id': 'req-be44f112-e805-4488-b3d3-e7b2c1918930'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:19.726299 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1293/2572] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:19.730958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff104c3-4fb7-4071-a68f-da3515f043c7 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.737978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] The token cache is being invalidate because project 42d12310d5e541fe8d5eed65629109df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:19.737978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:19.737978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:19.737978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1280/2573] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:19 2022] DELETE /identity/v3/projects/42d12310d5e541fe8d5eed65629109df => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:19.740976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.742402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:19.813053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff104c3-4fb7-4071-a68f-da3515f043c7 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.817430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f112-e805-4488-b3d3-e7b2c1918930 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:19.818369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.819004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.823102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.823414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.824215 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.826300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:19.826442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.827234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:19.827660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:19.828119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] PATH_INFO: `/v3/users/7f5d97683371482fa3582ff6b4a4b184` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:19.829419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5d97683371482fa3582ff6b4a4b184)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:19.831766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:19.844916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:19.966370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1294/2574] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:19 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:19.970520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:19.976186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:20.062284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:20.074611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30505821-1739-4acd-946b-bcc4e3089485 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:20.077316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5d97683371482fa3582ff6b4a4b184'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:20.078178 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5d97683371482fa3582ff6b4a4b184'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:20.079012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5d97683371482fa3582ff6b4a4b184'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:20.080101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:20.080781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.081250 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.081527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.082589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:20.084584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:20.201448 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5d97683371482fa3582ff6b4a4b184'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:20.209158 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1295/2575] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:19 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:20.209442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5d97683371482fa3582ff6b4a4b184'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:20.213978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:20.215889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:20.231964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b677b-ab21-46b4-bef9-f8e4715152f8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:20.232158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1281/2576] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:19 2022] DELETE /identity/v3/users/7f5d97683371482fa3582ff6b4a4b184 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:20.301264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:20.302288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.302755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.303223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.304370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:20.307086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:20.320703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1296/2577] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:20.326392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:20.337176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094574d-4d4f-4857-a7b8-309214f91303 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:20.342659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:20.345288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.345580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.345862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] PATH_INFO: `/v3/projects/2360bfc431444e2eb51987efe23d602f/users/7b59098aa17b415593143e99364f9aa0/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.362475 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360bfc431444e2eb51987efe23d602f, user_id=7b59098aa17b415593143e99364f9aa0, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:20.365707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:20.457447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1282/2578] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:20 2022] PUT /identity/v3/projects/2360bfc431444e2eb51987efe23d602f/users/7b59098aa17b415593143e99364f9aa0/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:20.459428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:20.471170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532ba34-56c2-4554-a191-8ef023885982 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:20.563350 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a842d-0bef-4eb2-b629-d2bfb4ae82a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:20.564207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a842d-0bef-4eb2-b629-d2bfb4ae82a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.564587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a842d-0bef-4eb2-b629-d2bfb4ae82a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.564958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a842d-0bef-4eb2-b629-d2bfb4ae82a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.565728 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a842d-0bef-4eb2-b629-d2bfb4ae82a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:20.567436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a842d-0bef-4eb2-b629-d2bfb4ae82a1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:20.591297 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1297/2579] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:20.591544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:20.606382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5651-783e-4cfb-a972-c0aa8f3bc23a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:20.612288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:20.613032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.617280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.617280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] PATH_INFO: `/v3/projects/2360bfc431444e2eb51987efe23d602f/users/7b59098aa17b415593143e99364f9aa0/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.617280 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2360bfc431444e2eb51987efe23d602f, user_id=7b59098aa17b415593143e99364f9aa0, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:20.619166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:20.630561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1283/2580] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:20 2022] PUT /identity/v3/projects/2360bfc431444e2eb51987efe23d602f/users/7b59098aa17b415593143e99364f9aa0/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:20.698876 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.699194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.699431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.726958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:20.726958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:20.749002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] MFA Rules not processed for user `7b59098aa17b415593143e99364f9aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:20.755568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:20.768860 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:20.842962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073bc2-98f1-43ad-9849-81d447a1852a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:20.855209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:20.855846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.856170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.856444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] PATH_INFO: `/v3/projects/7139f17c534948d19477015cd87c363b` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.857561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7139f17c534948d19477015cd87c363b)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:20.859778 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:20.876056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1298/2581] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:20.887464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:20.889375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:20.949452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4596dc-e2d4-4416-b9f1-947fe162be5b None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:20.953295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340f33c-46ed-47a2-b426-239c6d7141e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:20.953926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340f33c-46ed-47a2-b426-239c6d7141e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:20.954244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340f33c-46ed-47a2-b426-239c6d7141e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:20.954525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340f33c-46ed-47a2-b426-239c6d7141e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:20.956356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2340f33c-46ed-47a2-b426-239c6d7141e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:20.987897 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7139f17c534948d19477015cd87c363b', 'request_id': 'req-b2b42676-f10b-4334-93cd-75e30fa43810'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:20.994579 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7139f17c534948d19477015cd87c363b', 'request_id': 'req-b2b42676-f10b-4334-93cd-75e30fa43810'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:21.024373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340f33c-46ed-47a2-b426-239c6d7141e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.025833 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340f33c-46ed-47a2-b426-239c6d7141e1 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:21.035548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1299/2582] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:21.104709 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7139f17c534948d19477015cd87c363b', 'request_id': 'req-b2b42676-f10b-4334-93cd-75e30fa43810'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:21.117244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] The token cache is being invalidate because project 7139f17c534948d19477015cd87c363b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:21.117547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:21.118202 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b2b42676-f10b-4334-93cd-75e30fa43810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:21.120681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1284/2583] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:20 2022] DELETE /identity/v3/projects/7139f17c534948d19477015cd87c363b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:21.125410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4850-dc12-4097-a958-14b571cd683a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.125744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4850-dc12-4097-a958-14b571cd683a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.126136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4850-dc12-4097-a958-14b571cd683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.149524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-370f4850-dc12-4097-a958-14b571cd683a None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:21.150759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-370f4850-dc12-4097-a958-14b571cd683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:21.200411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:21.211693 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1300/2584] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:21.220378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d5ad-dd4d-4690-9273-e87d4bdc48bb None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.220885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d5ad-dd4d-4690-9273-e87d4bdc48bb None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.221009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490d5ad-dd4d-4690-9273-e87d4bdc48bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.232710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:21.246268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9490d5ad-dd4d-4690-9273-e87d4bdc48bb None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:21.247485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9490d5ad-dd4d-4690-9273-e87d4bdc48bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:21.260618 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1285/2585] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:21.261679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f4850-dc12-4097-a958-14b571cd683a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:21.272737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f4850-dc12-4097-a958-14b571cd683a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:21.278201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:21.278791 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.283556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.283556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.283556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:21.283556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.283556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:21.295376 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1301/2586] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:21.299780 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490d5ad-dd4d-4690-9273-e87d4bdc48bb None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:21.309651 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490d5ad-dd4d-4690-9273-e87d4bdc48bb None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:21.314331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:21.314928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.315225 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.315482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.316147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.318071 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:21.403617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1286/2587] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:21 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:21.407655 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:21.418369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edacc-04a8-4a77-9ca9-2b941818e6ec admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:21.475224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:21.475828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.476135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.476407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.477057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.479558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:21.572822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1302/2588] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:21 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:21.576959 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:21.587385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338d78d-905f-45ca-b03a-c724350f4bbf admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:21.592819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:21.593416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.593694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.593966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.594609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.596246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:21.606749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1287/2589] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:21.610623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:21.621043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30813780-057e-458c-8c18-15c5a48b01ef admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:21.625745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87b37c-3de5-419d-9868-86b6ee3e1382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:21.626364 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87b37c-3de5-419d-9868-86b6ee3e1382 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.626646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87b37c-3de5-419d-9868-86b6ee3e1382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.626922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87b37c-3de5-419d-9868-86b6ee3e1382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.627568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87b37c-3de5-419d-9868-86b6ee3e1382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.629198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87b37c-3de5-419d-9868-86b6ee3e1382 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:21.640319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1303/2590] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:21.644490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:21.656171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1070c-48a2-41fe-8696-615765c25c2b admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:21.660895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:21.661547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.661827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.662125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] PATH_INFO: `/v3/projects/daf7f8536e924cfeb23f002bdd7eb4ee/users/9b0de290e17a4bb8a73d0127e4b986b6/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.679578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf7f8536e924cfeb23f002bdd7eb4ee, user_id=9b0de290e17a4bb8a73d0127e4b986b6, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.682382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:21.751322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1288/2591] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:21 2022] PUT /identity/v3/projects/daf7f8536e924cfeb23f002bdd7eb4ee/users/9b0de290e17a4bb8a73d0127e4b986b6/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:21.762603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbf06-75f1-4447-98c4-de9e3acb43cc None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.762958 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbf06-75f1-4447-98c4-de9e3acb43cc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.763352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cbf06-75f1-4447-98c4-de9e3acb43cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.792202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f79cbf06-75f1-4447-98c4-de9e3acb43cc None None] MFA Rules not processed for user `9b0de290e17a4bb8a73d0127e4b986b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:21.793434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f79cbf06-75f1-4447-98c4-de9e3acb43cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:21.859067 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1304/2592] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:21.863465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:21.935675 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708a00d-7337-4ef3-881b-1b7417f164b1 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:21.940357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:21.940961 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:21.941241 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:21.941515 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:21.942164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:21.944100 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.050595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1289/2593] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:21 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:22.051678 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cbf06-75f1-4447-98c4-de9e3acb43cc None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.063883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cbf06-75f1-4447-98c4-de9e3acb43cc None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:22.118746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:22.128844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:22.129459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.129738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.130014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.130652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:22.132637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.250507 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1305/2594] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:22 2022] POST /identity/v3/users => generated 300 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:22.254279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.274126 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641381f-46a9-4106-b0f7-72415673e97e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:22.280462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:22.281082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.281528 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.281954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.287390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:22.287390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.296872 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1290/2595] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:22.301095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.311683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e6200-2d22-47ef-ad27-fc569aab323c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:22.316784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:22.317455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.317751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.318002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] PATH_INFO: `/v3/projects/11a6996aa8f24b089084436f9e8fccf2/users/1e2911d5a74041369e4fa8a677b05152/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.335773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a6996aa8f24b089084436f9e8fccf2, user_id=1e2911d5a74041369e4fa8a677b05152, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:22.339240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.422683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1306/2596] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:22 2022] PUT /identity/v3/projects/11a6996aa8f24b089084436f9e8fccf2/users/1e2911d5a74041369e4fa8a677b05152/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:22.426782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.437052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02f505-4db7-49ae-b482-c889cfd406f2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:22.497795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232dc33-3d50-4d89-9340-1ed89491b1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:22.498407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232dc33-3d50-4d89-9340-1ed89491b1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.498692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232dc33-3d50-4d89-9340-1ed89491b1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.498966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232dc33-3d50-4d89-9340-1ed89491b1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.499613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232dc33-3d50-4d89-9340-1ed89491b1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:22.501274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232dc33-3d50-4d89-9340-1ed89491b1ce admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.511115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1291/2597] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:22.515396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.527076 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cea84-8db9-471e-b4e1-72254668a303 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:22.533711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:22.534377 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.534650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.534923 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] PATH_INFO: `/v3/projects/11a6996aa8f24b089084436f9e8fccf2/users/1e2911d5a74041369e4fa8a677b05152/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.536888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a6996aa8f24b089084436f9e8fccf2, user_id=1e2911d5a74041369e4fa8a677b05152, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:22.539518 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.550971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1307/2598] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:22 2022] PUT /identity/v3/projects/11a6996aa8f24b089084436f9e8fccf2/users/1e2911d5a74041369e4fa8a677b05152/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:22.562706 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ae00-0d2a-424c-a2b7-38472c947120 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.563094 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ae00-0d2a-424c-a2b7-38472c947120 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.563444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ae00-0d2a-424c-a2b7-38472c947120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.585442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:22.595037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-85d4ae00-0d2a-424c-a2b7-38472c947120 None None] MFA Rules not processed for user `1e2911d5a74041369e4fa8a677b05152`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:22.597114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-85d4ae00-0d2a-424c-a2b7-38472c947120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:22.669832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1292/2599] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:22.681713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.685177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:22.774473 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c278-5f2e-4817-9c59-39fe63200b57 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:22.779686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:22.780436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.780813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.781182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.797226 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:22.798938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.812913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1308/2600] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:22.842498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ae00-0d2a-424c-a2b7-38472c947120 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.909859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ae00-0d2a-424c-a2b7-38472c947120 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:22.914600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:22.915228 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:22.915508 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:22.915813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] PATH_INFO: `/v3/users/9b0de290e17a4bb8a73d0127e4b986b6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:22.917207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0de290e17a4bb8a73d0127e4b986b6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:22.919121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:22.997047 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:22.998482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:23.011077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898fcad-3f3c-4882-b99c-9165dd7920b0 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:23.014713 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c0f56-40c1-4d88-8828-0880be374f0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:23.015305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0f56-40c1-4d88-8828-0880be374f0f service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:23.015587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0f56-40c1-4d88-8828-0880be374f0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:23.015855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0f56-40c1-4d88-8828-0880be374f0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:23.017620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b69c0f56-40c1-4d88-8828-0880be374f0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:23.080879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c0f56-40c1-4d88-8828-0880be374f0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:23.082362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c0f56-40c1-4d88-8828-0880be374f0f service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:23.092243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1309/2601] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:23.136047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0de290e17a4bb8a73d0127e4b986b6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:23.136819 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0de290e17a4bb8a73d0127e4b986b6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:23.137582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0de290e17a4bb8a73d0127e4b986b6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:23.206866 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0de290e17a4bb8a73d0127e4b986b6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:23.214805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0de290e17a4bb8a73d0127e4b986b6'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:23.232661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1293/2602] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:22 2022] DELETE /identity/v3/users/9b0de290e17a4bb8a73d0127e4b986b6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:23.237211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:23.237587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:23.237925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:23.258773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:23.260648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:23.307295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:23.330954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1310/2603] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:23.344047 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:23.345528 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:23.359777 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:23.529026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc062eb-f7fa-432c-af70-c671ece66c40 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:23.532601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:23.533200 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:23.533483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:23.533737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:23.542453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:23.543934 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:23.553069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1294/2604] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:23.968709 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:23.970122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:23.982036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147d927-a662-4d8e-bdc0-d282ed4567a1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:23.986634 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:23.987269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:23.987543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:23.987809 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] PATH_INFO: `/v3/projects/daf7f8536e924cfeb23f002bdd7eb4ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:23.989255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf7f8536e924cfeb23f002bdd7eb4ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:23.991651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:24.123830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf7f8536e924cfeb23f002bdd7eb4ee', 'request_id': 'req-1463bde8-77cd-42bd-a77d-197d3d8c9df9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.133030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf7f8536e924cfeb23f002bdd7eb4ee', 'request_id': 'req-1463bde8-77cd-42bd-a77d-197d3d8c9df9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.241767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf7f8536e924cfeb23f002bdd7eb4ee', 'request_id': 'req-1463bde8-77cd-42bd-a77d-197d3d8c9df9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.254496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] The token cache is being invalidate because project daf7f8536e924cfeb23f002bdd7eb4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:24.254786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.255450 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.257071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1311/2605] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:23 2022] DELETE /identity/v3/projects/daf7f8536e924cfeb23f002bdd7eb4ee => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:24.261245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:24.270817 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9260f-1d98-43d2-b41e-af028c02135b service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:24.327072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:24.327697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:24.328004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:24.328276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] PATH_INFO: `/v3/users/1e2911d5a74041369e4fa8a677b05152` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:24.329392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e2911d5a74041369e4fa8a677b05152)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:24.331311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:24.512781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e2911d5a74041369e4fa8a677b05152'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.513313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e2911d5a74041369e4fa8a677b05152'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.514026 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e2911d5a74041369e4fa8a677b05152'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.566761 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e2911d5a74041369e4fa8a677b05152'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.574516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e2911d5a74041369e4fa8a677b05152'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:24.583651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:24.585177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:24.593712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1295/2606] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:24 2022] DELETE /identity/v3/users/1e2911d5a74041369e4fa8a677b05152 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:24.650973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463bde8-77cd-42bd-a77d-197d3d8c9df9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:24.710279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb8173-615c-498c-9def-150a18b742ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:24.710889 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8173-615c-498c-9def-150a18b742ac service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:24.711161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8173-615c-498c-9def-150a18b742ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:24.711427 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8173-615c-498c-9def-150a18b742ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:24.713898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a8eb8173-615c-498c-9def-150a18b742ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:24.755425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:24.779659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb8173-615c-498c-9def-150a18b742ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:24.781174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb8173-615c-498c-9def-150a18b742ac service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:24.790530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1312/2607] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:25.108762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:25.110259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:25.160350 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:25.185130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87285e-d2a3-47be-9616-8cfbe5e36330 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:25.189814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:25.190444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.190723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.191001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] PATH_INFO: `/v3/projects/11a6996aa8f24b089084436f9e8fccf2` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.192158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a6996aa8f24b089084436f9e8fccf2)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:25.194066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:25.316750 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a6996aa8f24b089084436f9e8fccf2', 'request_id': 'req-b8978d76-b695-4d3e-8a1c-a721a1997796'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:25.322845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a6996aa8f24b089084436f9e8fccf2', 'request_id': 'req-b8978d76-b695-4d3e-8a1c-a721a1997796'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:25.401457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a6996aa8f24b089084436f9e8fccf2', 'request_id': 'req-b8978d76-b695-4d3e-8a1c-a721a1997796'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:25.412809 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] The token cache is being invalidate because project 11a6996aa8f24b089084436f9e8fccf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:25.413101 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:25.413766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b8978d76-b695-4d3e-8a1c-a721a1997796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:25.415263 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1296/2608] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:25 2022] DELETE /identity/v3/projects/11a6996aa8f24b089084436f9e8fccf2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:25.420428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511df8-a1cf-468d-aae3-2ef993c9722c None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.420931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511df8-a1cf-468d-aae3-2ef993c9722c None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.421039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511df8-a1cf-468d-aae3-2ef993c9722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.441163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e7511df8-a1cf-468d-aae3-2ef993c9722c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:25.442415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e7511df8-a1cf-468d-aae3-2ef993c9722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:25.508051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1313/2609] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:25.516664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.517119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.517211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.541727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:25.542548 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:25.550689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1297/2610] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:25.556783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511df8-a1cf-468d-aae3-2ef993c9722c None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:25.566587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511df8-a1cf-468d-aae3-2ef993c9722c None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:25.575219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:25.575219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.575219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.575219 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.575865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:25.575865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:25.576199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:25.581932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:25.583317 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:25.588816 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1314/2611] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:20:25.593169 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:25.603118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc256b8c-b338-46c2-9d86-24a6aefa190c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:25.608124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:25.608731 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.608995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.609270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.609897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:25.614930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:25.643061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34b5b-b3f2-42c2-95e6-88beda6a4df5 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:25.646793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:25.647399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.647674 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.647981 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.649705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:25.661806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:25.663180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:25.673524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1298/2612] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:25.706478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1315/2613] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:25 2022] POST /identity/v3/projects => generated 407 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:25.711497 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:25.723825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89df10-82f7-4266-9fb3-21b0399d3dbb service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:25.782915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:25.783534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.783879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.784119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.784749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:25.786737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:25.796275 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:25.933116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1299/2614] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:25 2022] POST /identity/v3/users => generated 304 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:25.937247 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:25.949060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678976d8-da26-4838-ade3-2c3b4dfabf88 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:25.954122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:25.954702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.954986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.955258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.956063 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:25.957730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:25.968762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1316/2615] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:25.973034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:25.983504 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe02d-d965-4c72-a0b6-ae5c21f7aaea admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:25.991889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2956-822d-4e37-9ae6-272692e7c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:25.992546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2956-822d-4e37-9ae6-272692e7c443 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:25.992822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2956-822d-4e37-9ae6-272692e7c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:25.993107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2956-822d-4e37-9ae6-272692e7c443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:25.993775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb2956-822d-4e37-9ae6-272692e7c443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:25.995655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb2956-822d-4e37-9ae6-272692e7c443 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.006828 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1300/2616] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:26.011977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:26.022745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a1d4-754f-4728-a6aa-5b40e7ceec8a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:26.028711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:26.029369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.029740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.029911 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] PATH_INFO: `/v3/projects/a38d46adc8b447969732c2bf43286638/users/c6f77b63447f44b693e26c087d33b863/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.045967 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38d46adc8b447969732c2bf43286638, user_id=c6f77b63447f44b693e26c087d33b863, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:26.048679 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.151244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1317/2617] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:26 2022] PUT /identity/v3/projects/a38d46adc8b447969732c2bf43286638/users/c6f77b63447f44b693e26c087d33b863/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:26.166036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4733-ad7c-415d-bde8-1884bb8e1a4b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.166430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4733-ad7c-415d-bde8-1884bb8e1a4b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.166851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4733-ad7c-415d-bde8-1884bb8e1a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.203795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-8b2e4733-ad7c-415d-bde8-1884bb8e1a4b None None] MFA Rules not processed for user `c6f77b63447f44b693e26c087d33b863`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:26.205138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8b2e4733-ad7c-415d-bde8-1884bb8e1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:26.282336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1301/2618] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:26 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:26.286929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:26.356923 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eb51d-7fc2-4577-9e9a-21a16e771b8b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:26.361652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:26.362264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.362542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.362823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.363440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:26.365738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.376224 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:26.481186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1318/2619] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:26 2022] POST /identity/v3/projects => generated 409 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:26.483020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4733-ad7c-415d-bde8-1884bb8e1a4b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:26.494510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4733-ad7c-415d-bde8-1884bb8e1a4b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:26.549789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:26.550439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.550659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.550928 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.551557 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:26.553514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.679462 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1302/2620] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:26 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:26.682355 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:26.693182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7af50b-cba0-46a4-bdbd-22b698f9acf3 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:26.700746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:26.701244 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.701632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.702009 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.703142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:26.704706 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.723316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1319/2621] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:26.724580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:26.736180 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33923d34-85cf-4937-8a3e-f01bc312a37e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:26.746191 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:26.747381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.747381 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.747586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] PATH_INFO: `/v3/projects/45501c2632f14d338afdff3e47a6d3de/users/8a595ef9c0c845fb871227c482074f58/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.768208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45501c2632f14d338afdff3e47a6d3de, user_id=8a595ef9c0c845fb871227c482074f58, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:26.771152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.861503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1303/2622] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:26 2022] PUT /identity/v3/projects/45501c2632f14d338afdff3e47a6d3de/users/8a595ef9c0c845fb871227c482074f58/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:26.866096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:26.877457 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a623734-e770-4039-b210-a86cb4c86ee8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:26.938485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159f93d-8293-49eb-a9f9-9e0019684532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:26.939109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f93d-8293-49eb-a9f9-9e0019684532 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.939389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f93d-8293-49eb-a9f9-9e0019684532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.939665 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f93d-8293-49eb-a9f9-9e0019684532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.940360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159f93d-8293-49eb-a9f9-9e0019684532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:26.942015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159f93d-8293-49eb-a9f9-9e0019684532 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.953356 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1320/2623] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:26.958074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:26.973080 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a9a0f-889d-4e79-be78-18990011725e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:26.978209 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:26.979393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:26.979717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:26.985573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] PATH_INFO: `/v3/projects/45501c2632f14d338afdff3e47a6d3de/users/8a595ef9c0c845fb871227c482074f58/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:26.985573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=45501c2632f14d338afdff3e47a6d3de, user_id=8a595ef9c0c845fb871227c482074f58, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:26.985573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:26.995944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1304/2624] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:26 2022] PUT /identity/v3/projects/45501c2632f14d338afdff3e47a6d3de/users/8a595ef9c0c845fb871227c482074f58/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:27.007080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402f8f-f114-4b88-b3ae-7eea7ed8c919 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:27.007372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402f8f-f114-4b88-b3ae-7eea7ed8c919 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:27.007650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af402f8f-f114-4b88-b3ae-7eea7ed8c919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:27.036090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-af402f8f-f114-4b88-b3ae-7eea7ed8c919 None None] MFA Rules not processed for user `8a595ef9c0c845fb871227c482074f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:27.037326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-af402f8f-f114-4b88-b3ae-7eea7ed8c919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:27.112577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1321/2625] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:27.124355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:27.126085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:27.159677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:27.195433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581172-1636-42d3-a0ee-b84fe19485ee admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:27.200250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:27.200878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:27.201151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:27.201491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:27.211806 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:27.213958 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:27.227895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1305/2626] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:27.708161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402f8f-f114-4b88-b3ae-7eea7ed8c919 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:27.718843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af402f8f-f114-4b88-b3ae-7eea7ed8c919 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:27.723102 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:27.723749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:27.724064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:27.724342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:27.785625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:27.787045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:27.792460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:27.799535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1322/2627] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:27 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:29.821009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:29.822461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:29.890364 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365acae-9acb-446b-a481-ce303e421dc6 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:29.895177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:29.895814 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:29.896119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:29.896392 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] PATH_INFO: `/v3/users/86fd818c1f894c388de9ca49c39a8cde` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:29.897789 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fd818c1f894c388de9ca49c39a8cde)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:29.899805 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:30.067699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:30.069370 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:30.085398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd58cc-31a5-4151-be42-2d7e9aafddae service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:30.094112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:30.094112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.094112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.094112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] PATH_INFO: `/v3/users/1ad7634e30294c30b2c40dee33c068f4` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.094843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad7634e30294c30b2c40dee33c068f4)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:30.096332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:30.138262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fd818c1f894c388de9ca49c39a8cde'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.138943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fd818c1f894c388de9ca49c39a8cde'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.139549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fd818c1f894c388de9ca49c39a8cde'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.218345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fd818c1f894c388de9ca49c39a8cde'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.228773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4785dae4-95ff-4c3d-bc74-3cce10308dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fd818c1f894c388de9ca49c39a8cde'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.248306 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1306/2628] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:29 2022] DELETE /identity/v3/users/86fd818c1f894c388de9ca49c39a8cde => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:30.314717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad7634e30294c30b2c40dee33c068f4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.329060 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad7634e30294c30b2c40dee33c068f4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.329772 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad7634e30294c30b2c40dee33c068f4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.401341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad7634e30294c30b2c40dee33c068f4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.409211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad7634e30294c30b2c40dee33c068f4'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.416032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1323/2629] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:30 2022] DELETE /identity/v3/users/1ad7634e30294c30b2c40dee33c068f4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:30.421660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.421948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.422226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.441960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:30.443149 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:30.482945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:30.502300 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1307/2630] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:30.506552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:30.508139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:30.512728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:30.514227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:30.525228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6a9ff-5230-459c-a254-4ae6ddbb9561 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:30.531424 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:30.532745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.533151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.533445 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] PATH_INFO: `/v3/projects/6f992bd094a646acb3ce5182abeb18f8` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.534614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f992bd094a646acb3ce5182abeb18f8)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:30.536748 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:30.582860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d04a46-3810-4c7f-8de7-0f672600a250 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:30.586496 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb159f-bc1d-40eb-9262-0f4e0f6f59a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:30.587102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb159f-bc1d-40eb-9262-0f4e0f6f59a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.587382 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb159f-bc1d-40eb-9262-0f4e0f6f59a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.587655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb159f-bc1d-40eb-9262-0f4e0f6f59a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.598029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb159f-bc1d-40eb-9262-0f4e0f6f59a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:30.599467 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb159f-bc1d-40eb-9262-0f4e0f6f59a7 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:30.609406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1308/2631] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:30.663936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f992bd094a646acb3ce5182abeb18f8', 'request_id': 'req-c88722c3-1d1d-4c71-8c5b-2f98e756786c'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.673468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f992bd094a646acb3ce5182abeb18f8', 'request_id': 'req-c88722c3-1d1d-4c71-8c5b-2f98e756786c'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.779139 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f992bd094a646acb3ce5182abeb18f8', 'request_id': 'req-c88722c3-1d1d-4c71-8c5b-2f98e756786c'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.790858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] The token cache is being invalidate because project 6f992bd094a646acb3ce5182abeb18f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:30.791154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.792976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-c88722c3-1d1d-4c71-8c5b-2f98e756786c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:30.794640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1324/2632] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:30 2022] DELETE /identity/v3/projects/6f992bd094a646acb3ce5182abeb18f8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:30.799678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422dc1e-a129-4abf-9375-13143f6d83ae None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.800012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422dc1e-a129-4abf-9375-13143f6d83ae None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.800295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422dc1e-a129-4abf-9375-13143f6d83ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.820574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f422dc1e-a129-4abf-9375-13143f6d83ae None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:30.821878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f422dc1e-a129-4abf-9375-13143f6d83ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:30.895661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1309/2633] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:30.904339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055eb4-6a85-4bfa-822b-b23079cccee1 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.904625 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055eb4-6a85-4bfa-822b-b23079cccee1 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.904902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055eb4-6a85-4bfa-822b-b23079cccee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.925632 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d0055eb4-6a85-4bfa-822b-b23079cccee1 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:30.926853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d0055eb4-6a85-4bfa-822b-b23079cccee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:30.938904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1325/2634] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:30.940345 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422dc1e-a129-4abf-9375-13143f6d83ae None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:30.951099 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422dc1e-a129-4abf-9375-13143f6d83ae None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:30.956052 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:30.956662 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.956936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.957201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.957843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:30.958145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:30.959826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:30.972083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1310/2635] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:30.976707 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0055eb4-6a85-4bfa-822b-b23079cccee1 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:30.986617 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0055eb4-6a85-4bfa-822b-b23079cccee1 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:30.991768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:30.992439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:30.992720 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:30.992994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:30.993642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:30.996289 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.049253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:31.051045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:31.065565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad50f26-742a-4b63-87bd-8eac0bf6128e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:31.070568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:31.071779 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.072259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.072542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] PATH_INFO: `/v3/projects/5656d6344d094e3d8a2814e41fba5254` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.073826 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5656d6344d094e3d8a2814e41fba5254)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:31.075859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.124897 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1326/2636] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:30 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:31.128907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:31.157071 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:31.191526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88de67-d6ad-463f-ada7-b3fec0abd567 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:31.196378 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:31.196987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.197265 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.197537 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.198194 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:31.200154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.231050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5656d6344d094e3d8a2814e41fba5254', 'request_id': 'req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.237881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5656d6344d094e3d8a2814e41fba5254', 'request_id': 'req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.328435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1327/2637] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:31 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:31.331777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:31.341913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f968f-7628-405e-bed0-af19736fa064 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:31.343718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5656d6344d094e3d8a2814e41fba5254', 'request_id': 'req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.351849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:31.358966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] The token cache is being invalidate because project 5656d6344d094e3d8a2814e41fba5254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:31.358966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.358966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.362732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1311/2638] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:31 2022] DELETE /identity/v3/projects/5656d6344d094e3d8a2814e41fba5254 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:31.363578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:31.365231 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:31.399505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:31.400220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.400500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.400769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.402045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:31.403658 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.413648 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1328/2639] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:31.418333 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:31.420245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:31.428728 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc9fe0-22b4-4bb8-91aa-725e0d5a7933 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:31.433690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:31.434345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f1bf-70bc-4da3-9a96-5dc73af8742c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:31.434484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.434635 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.434908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] PATH_INFO: `/v3/users/8885198c56a64580acdcdf8b41acf072` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.436184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8885198c56a64580acdcdf8b41acf072)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:31.438092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.439673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:31.440441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.440814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.441090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.441730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:31.443339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.455456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1329/2640] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:31.459553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:31.469711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ecf70-0cab-4871-8a5f-ac264441ab05 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:31.474234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1b23b-55a9-499a-a8c5-e047d2960734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:31.474858 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b23b-55a9-499a-a8c5-e047d2960734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.475134 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b23b-55a9-499a-a8c5-e047d2960734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.475406 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b23b-55a9-499a-a8c5-e047d2960734 admin admin] PATH_INFO: `/v3/projects/6ae05660d84743a982e2dca4caba08c6/users/4168274f7ad04add802a472fc772f806/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.490213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1b23b-55a9-499a-a8c5-e047d2960734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae05660d84743a982e2dca4caba08c6, user_id=4168274f7ad04add802a472fc772f806, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:31.492945 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1b23b-55a9-499a-a8c5-e047d2960734 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.565403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1330/2641] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:31 2022] PUT /identity/v3/projects/6ae05660d84743a982e2dca4caba08c6/users/4168274f7ad04add802a472fc772f806/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:31.570285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.570666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.571054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.591210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:31.592608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:31.654602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1331/2642] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:31.664379 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:31.665767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:31.670977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8885198c56a64580acdcdf8b41acf072'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.671837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8885198c56a64580acdcdf8b41acf072'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.672629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8885198c56a64580acdcdf8b41acf072'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.723586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516824d-e20a-43dc-94e7-0e1eb9f02ecd None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:31.727361 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:31.727998 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:31.728349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:31.728691 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:31.730506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:31.742326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:31.743749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:31.753245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1332/2643] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:31.755756 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8885198c56a64580acdcdf8b41acf072'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.765680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8885198c56a64580acdcdf8b41acf072'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:31.784033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1312/2644] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:31 2022] DELETE /identity/v3/users/8885198c56a64580acdcdf8b41acf072 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:32.280818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:32.281893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:32.295104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d608de-051c-4654-867b-01ce4e9b00d1 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:32.352703 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:32.353334 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:32.353616 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:32.353893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] PATH_INFO: `/v3/projects/1076b5d694ea433aa7eda41964338578` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:32.355276 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1076b5d694ea433aa7eda41964338578)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:32.357231 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:32.533042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1076b5d694ea433aa7eda41964338578', 'request_id': 'req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:32.539161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1076b5d694ea433aa7eda41964338578', 'request_id': 'req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:32.618571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1076b5d694ea433aa7eda41964338578', 'request_id': 'req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:32.621232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:32.631516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] The token cache is being invalidate because project 1076b5d694ea433aa7eda41964338578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:32.631812 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:32.632482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:32.634021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1333/2645] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:32 2022] DELETE /identity/v3/projects/1076b5d694ea433aa7eda41964338578 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:32.638634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:32.648698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e7721-ca4a-440a-8dce-34426a8dfbe1 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:32.719038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:32.719691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:32.719989 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:32.720266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] PATH_INFO: `/v3/users/7b59098aa17b415593143e99364f9aa0` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:32.721408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b59098aa17b415593143e99364f9aa0)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:32.723388 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:32.746971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:32.964855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b59098aa17b415593143e99364f9aa0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:32.965524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b59098aa17b415593143e99364f9aa0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:32.966119 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b59098aa17b415593143e99364f9aa0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.052719 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b59098aa17b415593143e99364f9aa0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.060589 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4800f51a-614f-438f-b320-5db093037ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b59098aa17b415593143e99364f9aa0'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.077898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1313/2646] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:32 2022] DELETE /identity/v3/users/7b59098aa17b415593143e99364f9aa0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:33.543259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:33.545744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:33.578159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918f05-9eb6-4fd6-a7aa-ef4bb13b6955 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:33.651951 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:33.664999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:33.670240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:33.670240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:33.670240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] PATH_INFO: `/v3/projects/2360bfc431444e2eb51987efe23d602f` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:33.670240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2360bfc431444e2eb51987efe23d602f)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:33.670240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:33.831570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2360bfc431444e2eb51987efe23d602f', 'request_id': 'req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.844733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2360bfc431444e2eb51987efe23d602f', 'request_id': 'req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.933933 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2360bfc431444e2eb51987efe23d602f', 'request_id': 'req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.944781 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] The token cache is being invalidate because project 2360bfc431444e2eb51987efe23d602f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:33.945167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.945863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3af7cb7f-9fa4-4017-8fc9-d7da047d2060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:33.947410 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1334/2647] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:33 2022] DELETE /identity/v3/projects/2360bfc431444e2eb51987efe23d602f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:33.954558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0eb2-0305-41d4-b04a-54e545782935 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:33.955107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0eb2-0305-41d4-b04a-54e545782935 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:33.955107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc0eb2-0305-41d4-b04a-54e545782935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:33.976484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-32dc0eb2-0305-41d4-b04a-54e545782935 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:33.977742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-32dc0eb2-0305-41d4-b04a-54e545782935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:34.047887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1314/2648] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:34.058535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017cff4-ef3d-4752-a29e-e919b91d9cd9 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.058884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017cff4-ef3d-4752-a29e-e919b91d9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.059168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017cff4-ef3d-4752-a29e-e919b91d9cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.096436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-e017cff4-ef3d-4752-a29e-e919b91d9cd9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:34.098035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-e017cff4-ef3d-4752-a29e-e919b91d9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:34.112390 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1335/2649] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:34.114141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc0eb2-0305-41d4-b04a-54e545782935 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:34.127783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc0eb2-0305-41d4-b04a-54e545782935 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:34.134412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:34.135955 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.136769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.137454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.139186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:34.139600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:34.144133 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:34.158320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1315/2650] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:34.164030 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017cff4-ef3d-4752-a29e-e919b91d9cd9 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:34.178842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017cff4-ef3d-4752-a29e-e919b91d9cd9 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:34.181190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:34.181819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.182161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.182483 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.183399 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:34.185670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:34.377447 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1336/2651] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:34 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:34.381742 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:34.393279 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914f2e6-0e32-43cf-bdc3-d8d1bd2918ac admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:34.477060 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:34.477669 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.477945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.478220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.478862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:34.481195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:34.580116 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1316/2652] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:34 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:34.583626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:34.593894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d29ffd-e779-4413-a031-93d1f9b5e851 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:34.598389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:34.598983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.599259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.599526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.600275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:34.601855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:34.740528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1337/2653] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:34.744513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:34.755942 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cedb94-932c-44b9-908e-8663b9750f6a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:34.761001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30123eb3-5cc2-4828-8aa3-99071effc65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:34.761621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30123eb3-5cc2-4828-8aa3-99071effc65e admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.761895 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30123eb3-5cc2-4828-8aa3-99071effc65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.762172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30123eb3-5cc2-4828-8aa3-99071effc65e admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.762957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30123eb3-5cc2-4828-8aa3-99071effc65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:34.764615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30123eb3-5cc2-4828-8aa3-99071effc65e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:34.776571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1317/2654] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:34.780688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:34.795795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb5f3f-37fb-47d7-8987-e38c139b913a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:34.800568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:34.801278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.801554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.801821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] PATH_INFO: `/v3/projects/eb9c57eb1bb14a9e8015324b09509927/users/12c62042cac74050a2dce7b7e9f2cb36/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.819487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9c57eb1bb14a9e8015324b09509927, user_id=12c62042cac74050a2dce7b7e9f2cb36, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:34.822456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:34.960113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1338/2655] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:34 2022] PUT /identity/v3/projects/eb9c57eb1bb14a9e8015324b09509927/users/12c62042cac74050a2dce7b7e9f2cb36/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:34.968932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:34.969813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:34.970254 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:34.978067 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:35.001243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] MFA Rules not processed for user `12c62042cac74050a2dce7b7e9f2cb36`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:35.002492 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:35.077546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1318/2656] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:35.091671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:35.093699 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:35.157715 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0234f-7b5d-4c14-bc71-e1cc681f42fc admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:35.161685 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:35.162599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:35.163064 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:35.163340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:35.172854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:35.174317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:35.184887 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1339/2657] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:35.191247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:35.194854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:35.221598 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:35.288800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e172-8942-4bae-a099-fffdae072f7d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:35.295001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:35.300953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:35.300953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:35.300953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] PATH_INFO: `/v3/users/c6f77b63447f44b693e26c087d33b863` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:35.300953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f77b63447f44b693e26c087d33b863)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:35.301319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151954c-e495-404b-a8bc-a02608b9d4d0 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:35.301410 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:35.303746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:35.304668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:35.305166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:35.305638 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] PATH_INFO: `/v3/users/12c62042cac74050a2dce7b7e9f2cb36` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:35.307001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c62042cac74050a2dce7b7e9f2cb36)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:35.309863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:35.320519 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:35.500309 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f77b63447f44b693e26c087d33b863'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.501423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f77b63447f44b693e26c087d33b863'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.502259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f77b63447f44b693e26c087d33b863'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.527192 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c62042cac74050a2dce7b7e9f2cb36'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.544413 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c62042cac74050a2dce7b7e9f2cb36'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.548461 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c62042cac74050a2dce7b7e9f2cb36'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.591375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f77b63447f44b693e26c087d33b863'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.607214 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-6e0bda21-00f9-4923-b8c0-fb3820dd67de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f77b63447f44b693e26c087d33b863'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.630397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1319/2658] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:35 2022] DELETE /identity/v3/users/c6f77b63447f44b693e26c087d33b863 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:35.636020 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:35.636495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:35.636783 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:35.664090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:35.664090 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:35.681612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c62042cac74050a2dce7b7e9f2cb36'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.689966 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b0d26ac6-a513-4fb0-889c-bdd01ddd13e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c62042cac74050a2dce7b7e9f2cb36'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:35.697469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1340/2659] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:35 2022] DELETE /identity/v3/users/12c62042cac74050a2dce7b7e9f2cb36 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:35.706756 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf348f-83c5-4c3a-a87c-91c281cc00ce None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:35.707173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf348f-83c5-4c3a-a87c-91c281cc00ce None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:35.707795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf348f-83c5-4c3a-a87c-91c281cc00ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:35.728498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d6bf348f-83c5-4c3a-a87c-91c281cc00ce None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:35.730025 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d6bf348f-83c5-4c3a-a87c-91c281cc00ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:35.733746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1320/2660] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:35.745346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:35.747867 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:35.810873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1341/2661] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:35.821105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf348f-83c5-4c3a-a87c-91c281cc00ce None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:35.828910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad077f-b8a3-46ef-a9b3-93cf7dd8b477 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:35.890547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:35.891168 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:35.891447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:35.891887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:35.896103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf348f-83c5-4c3a-a87c-91c281cc00ce None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:35.901603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:35.902501 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:35.902787 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:35.904108 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:35.910764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:35.910764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:35.915162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:35.917079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:35.921318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1321/2662] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:35.934338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1342/2663] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:36.448142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:36.522224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:36.523941 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:36.570976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2583c9-13e8-45a8-a5ad-545a89cc3c46 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:36.570976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:36.570976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:36.570976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:36.572169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] PATH_INFO: `/v3/projects/a38d46adc8b447969732c2bf43286638` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:36.572169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38d46adc8b447969732c2bf43286638)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:36.572169 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:36.731395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:36.735994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:36.746545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38d46adc8b447969732c2bf43286638', 'request_id': 'req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:36.754051 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38d46adc8b447969732c2bf43286638', 'request_id': 'req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:36.766640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0ebc-8267-42bc-9ba9-7666c4131655 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:36.807624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:36.836262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38d46adc8b447969732c2bf43286638', 'request_id': 'req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:36.852165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:36.852572 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:36.852849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:36.853123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] PATH_INFO: `/v3/projects/eb9c57eb1bb14a9e8015324b09509927` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:36.856316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] The token cache is being invalidate because project a38d46adc8b447969732c2bf43286638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:36.856606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:36.857112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9c57eb1bb14a9e8015324b09509927)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:36.858107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:36.860552 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:36.861564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1322/2664] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:36 2022] DELETE /identity/v3/projects/a38d46adc8b447969732c2bf43286638 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:36.865444 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:36.867482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:36.895217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd83aa-2bfd-4bd8-b9e7-8c9e69cde8d4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:36.905283 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:36.906477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:36.906615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:36.907000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] PATH_INFO: `/v3/users/8a595ef9c0c845fb871227c482074f58` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:36.908580 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a595ef9c0c845fb871227c482074f58)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:36.910977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.003767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9c57eb1bb14a9e8015324b09509927', 'request_id': 'req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.011835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9c57eb1bb14a9e8015324b09509927', 'request_id': 'req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.124100 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9c57eb1bb14a9e8015324b09509927', 'request_id': 'req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.146921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] The token cache is being invalidate because project eb9c57eb1bb14a9e8015324b09509927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:37.148666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.149552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a595ef9c0c845fb871227c482074f58'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.152015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-95a39cd2-6e22-4d0b-b9e1-dabeef5610b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.152177 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a595ef9c0c845fb871227c482074f58'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.152396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a595ef9c0c845fb871227c482074f58'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.153891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1343/2665] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:36 2022] DELETE /identity/v3/projects/eb9c57eb1bb14a9e8015324b09509927 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:37.158363 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf061bd7-974a-4f52-9c36-4b54d9d8c357 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.158841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf061bd7-974a-4f52-9c36-4b54d9d8c357 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.159125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf061bd7-974a-4f52-9c36-4b54d9d8c357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.180120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-cf061bd7-974a-4f52-9c36-4b54d9d8c357 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:37.181353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-cf061bd7-974a-4f52-9c36-4b54d9d8c357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:37.212948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a595ef9c0c845fb871227c482074f58'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.222615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-df992e01-9e20-4748-b18e-05cf2967647c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a595ef9c0c845fb871227c482074f58'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:37.253064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1323/2666] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:36 2022] DELETE /identity/v3/users/8a595ef9c0c845fb871227c482074f58 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:37.276517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1344/2667] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:37.288536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4155-167d-4148-a15a-8a5bf52dcabe None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.288918 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4155-167d-4148-a15a-8a5bf52dcabe None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.289290 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf4155-167d-4148-a15a-8a5bf52dcabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.334057 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-0caf4155-167d-4148-a15a-8a5bf52dcabe None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:37.336564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0caf4155-167d-4148-a15a-8a5bf52dcabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:37.434879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1324/2668] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:37.436171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf061bd7-974a-4f52-9c36-4b54d9d8c357 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:37.450210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf061bd7-974a-4f52-9c36-4b54d9d8c357 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:37.462113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d87e4-00e0-4833-b0a0-573eb3dde82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:37.462113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d87e4-00e0-4833-b0a0-573eb3dde82e admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.462113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d87e4-00e0-4833-b0a0-573eb3dde82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.462113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d87e4-00e0-4833-b0a0-573eb3dde82e admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.462554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d87e4-00e0-4833-b0a0-573eb3dde82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:37.462554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d87e4-00e0-4833-b0a0-573eb3dde82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:37.462554 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d87e4-00e0-4833-b0a0-573eb3dde82e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.483770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1345/2669] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:37.492408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4155-167d-4148-a15a-8a5bf52dcabe None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:37.508960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf4155-167d-4148-a15a-8a5bf52dcabe None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:37.514852 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:37.515785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.516171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.516547 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.517302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:37.520743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.612716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.613003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.613277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.638585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1325/2670] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:37 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:37.643074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:37.664291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] MFA Rules not processed for user `4168274f7ad04add802a472fc772f806`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:37.665528 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:37.746514 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021b386-29eb-4704-8005-1bceb5aae18c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:37.751811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:37.752564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.754084 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.754419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.755218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:37.760945 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.764068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1346/2671] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:37.779982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:37.781624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:37.847991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1326/2672] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:37 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:37.852943 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:37.854734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:37.877017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a01db-96cb-4d88-b8c2-17d80c9ecbe0 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:37.877017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:37.877017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.877017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.877682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] PATH_INFO: `/v3/projects/45501c2632f14d338afdff3e47a6d3de` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.879464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45501c2632f14d338afdff3e47a6d3de)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:37.881710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.885662 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aace83-0ddd-4040-8713-d5f7c2cd3de7 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:37.893095 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:37.893722 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.893997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.894268 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.904514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:37.909757 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.918442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1347/2673] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:37.919317 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:37.931078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca37a7-dd42-4379-bbc2-d297ee7310d5 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:37.936862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:37.937418 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.937681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.938035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.938714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:37.940607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.952773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1348/2674] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:37.956810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:37.973465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d9c7a-d2ef-40c3-ae45-7fbc8489934a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:37.974578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:37.978818 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:37.983896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:37.983896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:37.983896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:37.983896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:37.983896 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:37.994284 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1349/2675] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:37.998357 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.008912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76cda5-93dd-4653-aa70-ae065d26d27c admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.014429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6000142-5a85-4232-a4fd-8ff2b7b5cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.015257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6000142-5a85-4232-a4fd-8ff2b7b5cbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.015602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6000142-5a85-4232-a4fd-8ff2b7b5cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.015968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6000142-5a85-4232-a4fd-8ff2b7b5cbe3 admin admin] PATH_INFO: `/v3/projects/4f67ae0a3ccc40e6b32bf78b9711a104/users/9b6fa5d6022a48298debc2d174fef889/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.034853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6000142-5a85-4232-a4fd-8ff2b7b5cbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f67ae0a3ccc40e6b32bf78b9711a104, user_id=9b6fa5d6022a48298debc2d174fef889, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.037790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6000142-5a85-4232-a4fd-8ff2b7b5cbe3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:38.125148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1350/2676] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:37 2022] PUT /identity/v3/projects/4f67ae0a3ccc40e6b32bf78b9711a104/users/9b6fa5d6022a48298debc2d174fef889/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:20:38.132663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45501c2632f14d338afdff3e47a6d3de', 'request_id': 'req-861df496-9a03-4f66-8e0c-7568dd33363c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:38.137692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.141936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.142472 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.151482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45501c2632f14d338afdff3e47a6d3de', 'request_id': 'req-861df496-9a03-4f66-8e0c-7568dd33363c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:38.177360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] MFA Rules not processed for user `9b6fa5d6022a48298debc2d174fef889`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:38.178609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:38.249020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1351/2677] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:38.253421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:38.262015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.263474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:38.270147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45501c2632f14d338afdff3e47a6d3de', 'request_id': 'req-861df496-9a03-4f66-8e0c-7568dd33363c'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:38.284760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] The token cache is being invalidate because project 45501c2632f14d338afdff3e47a6d3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:38.286004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:38.287148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-861df496-9a03-4f66-8e0c-7568dd33363c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:38.289896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1327/2678] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:37 2022] DELETE /identity/v3/projects/45501c2632f14d338afdff3e47a6d3de => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:38.300328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b02c-60ae-414b-bcb2-e40a5b5d3484 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.300328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b02c-60ae-414b-bcb2-e40a5b5d3484 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.300328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b02c-60ae-414b-bcb2-e40a5b5d3484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.320425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-4b54b02c-60ae-414b-bcb2-e40a5b5d3484 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:38.321801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4b54b02c-60ae-414b-bcb2-e40a5b5d3484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:38.351468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697c03d-6418-4295-bbef-5b6c28e283d3 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.357196 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2a0fd-8d34-4fc0-a687-625cc5a001e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.357825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a0fd-8d34-4fc0-a687-625cc5a001e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.358105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a0fd-8d34-4fc0-a687-625cc5a001e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.358380 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2a0fd-8d34-4fc0-a687-625cc5a001e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.360520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-06f2a0fd-8d34-4fc0-a687-625cc5a001e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:38.374895 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a0fd-8d34-4fc0-a687-625cc5a001e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.376409 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2a0fd-8d34-4fc0-a687-625cc5a001e2 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:38.387077 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1352/2679] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:38.395948 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1328/2680] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:38.401272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be3c4-d7d9-4f21-af21-d8d8a8c9e039 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.401695 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be3c4-d7d9-4f21-af21-d8d8a8c9e039 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.408311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116be3c4-d7d9-4f21-af21-d8d8a8c9e039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.431767 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-116be3c4-d7d9-4f21-af21-d8d8a8c9e039 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:38.433295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-116be3c4-d7d9-4f21-af21-d8d8a8c9e039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:38.445673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1353/2681] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:38.450924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54b02c-60ae-414b-bcb2-e40a5b5d3484 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.461640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54b02c-60ae-414b-bcb2-e40a5b5d3484 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.467471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.468192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.468464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.468749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.469446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:38.470159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.472039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:38.489009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1329/2682] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:38.493768 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be3c4-d7d9-4f21-af21-d8d8a8c9e039 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.504602 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116be3c4-d7d9-4f21-af21-d8d8a8c9e039 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.510263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.510993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.511368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.511723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.512451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.514689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:38.661117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1354/2683] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:38 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:38.665558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.677977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1903470-64ff-4f7b-bda2-18145294da20 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.761707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.762661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.763147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.763671 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.764856 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.767788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:38.843320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1330/2684] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:38 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:38.844591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.856174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70ac45-4d67-495b-980c-2ee050b565c9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.861404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.862006 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.862286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.862610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.863389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.865281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:38.875743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1355/2685] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:38.879995 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.890414 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ebf3-0ce3-47f9-ac26-925b28fe2539 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.895049 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05273193-8f54-4b92-a729-bf9d73b693ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.895639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273193-8f54-4b92-a729-bf9d73b693ab admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.895933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273193-8f54-4b92-a729-bf9d73b693ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.896269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273193-8f54-4b92-a729-bf9d73b693ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.896938 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05273193-8f54-4b92-a729-bf9d73b693ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.898574 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05273193-8f54-4b92-a729-bf9d73b693ab admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:38.913338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1331/2686] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:38.920267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:38.930542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b766f8-a634-47f7-88b9-39e853be974d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:38.936187 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:38.936487 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:38.936770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:38.937046 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] PATH_INFO: `/v3/projects/5fe59b5d4a7b4da3a40a1b9d29152428/users/1297b0a6f7b44c5097f34e82610b3bcf/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:38.952053 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe59b5d4a7b4da3a40a1b9d29152428, user_id=1297b0a6f7b44c5097f34e82610b3bcf, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:38.954743 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:39.102815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1356/2687] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:38 2022] PUT /identity/v3/projects/5fe59b5d4a7b4da3a40a1b9d29152428/users/1297b0a6f7b44c5097f34e82610b3bcf/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:39.115726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125c2b1-d4e3-4342-9ddc-6bc8c82825db None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.116056 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125c2b1-d4e3-4342-9ddc-6bc8c82825db None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.116332 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125c2b1-d4e3-4342-9ddc-6bc8c82825db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.146584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-7125c2b1-d4e3-4342-9ddc-6bc8c82825db None None] MFA Rules not processed for user `1297b0a6f7b44c5097f34e82610b3bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:39.147986 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-7125c2b1-d4e3-4342-9ddc-6bc8c82825db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:39.218190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1332/2688] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:39.222976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:39.319533 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e523d-fb65-474e-8781-d27011bba52a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:39.328386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:39.329005 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.329287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.329560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.330201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:39.333408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:39.450179 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1357/2689] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:39.450277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125c2b1-d4e3-4342-9ddc-6bc8c82825db None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:39.459197 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125c2b1-d4e3-4342-9ddc-6bc8c82825db None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:39.520637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:39.521259 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.521647 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.521932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.522606 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:39.524575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:39.639458 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1333/2690] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:39 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:39.641281 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:39.653753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ac45c-edc8-4521-8a28-d43eca182a8e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:39.659217 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:39.661640 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:39.662391 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.662991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.663161 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.663779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:39.665605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:39.681480 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1358/2691] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:39.683445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:39.694481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624fea4-50cd-4b09-8f4c-cbf1ecef714e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:39.700607 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:39.701554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.701995 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.702403 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] PATH_INFO: `/v3/projects/f439c49d25c34785876cd0ba1f2b859d/users/5d171190f1d84c77b8adb55fc6f4203f/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.721658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f439c49d25c34785876cd0ba1f2b859d, user_id=5d171190f1d84c77b8adb55fc6f4203f, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:39.724545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:39.811570 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1334/2692] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:39 2022] PUT /identity/v3/projects/f439c49d25c34785876cd0ba1f2b859d/users/5d171190f1d84c77b8adb55fc6f4203f/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:39.812837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:39.824623 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a84b1-cb10-42da-b89d-657a15a610d1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:39.894877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4add3-a591-4578-8484-3a530979a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:39.895612 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4add3-a591-4578-8484-3a530979a200 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.895771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4add3-a591-4578-8484-3a530979a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.896048 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4add3-a591-4578-8484-3a530979a200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.896688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4add3-a591-4578-8484-3a530979a200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:39.898285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4add3-a591-4578-8484-3a530979a200 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:39.905659 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:39.911227 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1359/2693] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:39.915436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:39.926568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44fb43-a926-4ddf-8681-029a0995b1d7 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:39.931249 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:39.932554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.933111 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.933461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] PATH_INFO: `/v3/projects/f439c49d25c34785876cd0ba1f2b859d/users/5d171190f1d84c77b8adb55fc6f4203f/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.935437 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f439c49d25c34785876cd0ba1f2b859d, user_id=5d171190f1d84c77b8adb55fc6f4203f, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:39.938145 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:39.949644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1335/2694] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:39 2022] PUT /identity/v3/projects/f439c49d25c34785876cd0ba1f2b859d/users/5d171190f1d84c77b8adb55fc6f4203f/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:39.962368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d969e5-8ee5-431b-ad16-1469c49f6988 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:39.962651 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d969e5-8ee5-431b-ad16-1469c49f6988 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:39.962925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d969e5-8ee5-431b-ad16-1469c49f6988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:39.996462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-02d969e5-8ee5-431b-ad16-1469c49f6988 None None] MFA Rules not processed for user `5d171190f1d84c77b8adb55fc6f4203f`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:39.997742 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-02d969e5-8ee5-431b-ad16-1469c49f6988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:40.099278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1360/2695] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:40.111765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:40.113723 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:40.198297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce6519-6639-4401-a5ff-8239dfcd96a4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:40.202696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e5581-8b74-4ea7-a77e-5c3fb9617c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:40.203457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e5581-8b74-4ea7-a77e-5c3fb9617c87 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:40.208600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e5581-8b74-4ea7-a77e-5c3fb9617c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:40.208600 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e5581-8b74-4ea7-a77e-5c3fb9617c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:40.267877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e5581-8b74-4ea7-a77e-5c3fb9617c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:40.269441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e5581-8b74-4ea7-a77e-5c3fb9617c87 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:40.281509 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1336/2696] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:20:40.463061 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:40.464823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:40.465109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:40.504308 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] MFA Rules not processed for user `9b6fa5d6022a48298debc2d174fef889`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:40.514320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:40.601080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1361/2697] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:40.741101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:40.905117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:40.920287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ac18-f842-481e-9852-a611c03e3dab None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:40.920568 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ac18-f842-481e-9852-a611c03e3dab None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:40.921050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29ac18-f842-481e-9852-a611c03e3dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:40.942091 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-de29ac18-f842-481e-9852-a611c03e3dab None None] MFA Rules not processed for user `4168274f7ad04add802a472fc772f806`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:40.943613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-de29ac18-f842-481e-9852-a611c03e3dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:41.013915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1337/2698] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:41.421712 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:41.423207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:41.484690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd9f00-ba9c-428d-b5d7-e957a95f810a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:41.488393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:41.495553 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:41.496097 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:41.496615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:41.500762 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:41.515290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:41.516943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:41.528078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1362/2699] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:42.173115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:42.887832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:46.104338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29ac18-f842-481e-9852-a611c03e3dab None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:46.116447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29ac18-f842-481e-9852-a611c03e3dab None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:46.122237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc10aa-c125-4ea7-9c41-183b3ceb1810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:46.123082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc10aa-c125-4ea7-9c41-183b3ceb1810 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:46.123752 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc10aa-c125-4ea7-9c41-183b3ceb1810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:46.124396 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc10aa-c125-4ea7-9c41-183b3ceb1810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:46.138261 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc10aa-c125-4ea7-9c41-183b3ceb1810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:46.149985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc10aa-c125-4ea7-9c41-183b3ceb1810 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:46.153536 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1338/2700] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:52.162943 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:52.229614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab88500-7efe-4a69-ae11-a26b093c93b9 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:52.234674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:52.235307 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:52.235587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:52.235859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] PATH_INFO: `/v3/users/1297b0a6f7b44c5097f34e82610b3bcf` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:52.237042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1297b0a6f7b44c5097f34e82610b3bcf)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:52.238983 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:52.397717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1297b0a6f7b44c5097f34e82610b3bcf'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:52.410165 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1297b0a6f7b44c5097f34e82610b3bcf'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:52.410869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1297b0a6f7b44c5097f34e82610b3bcf'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:52.492430 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1297b0a6f7b44c5097f34e82610b3bcf'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:52.501775 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1297b0a6f7b44c5097f34e82610b3bcf'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:52.511151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1363/2701] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:52 2022] DELETE /identity/v3/users/1297b0a6f7b44c5097f34e82610b3bcf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:52.513734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:52.514545 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:52.514824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:52.542903 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:52.544476 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:52.597960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:52.616268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1339/2702] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:52.626795 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:52.629033 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:52.649127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:52.687174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ff623-b1cb-478d-886e-3cf72c891409 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:52.690856 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:52.691462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:52.691741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:52.695298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:52.701181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:52.702773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:52.712681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1364/2703] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:53.168510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:53.170726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:53.183282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22203378-d700-4fa0-a288-ba51d329fff7 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:53.188538 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:53.189325 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:53.189613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:53.189885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] PATH_INFO: `/v3/projects/5fe59b5d4a7b4da3a40a1b9d29152428` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:53.191072 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe59b5d4a7b4da3a40a1b9d29152428)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:53.193066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:53.283613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe59b5d4a7b4da3a40a1b9d29152428', 'request_id': 'req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.291737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe59b5d4a7b4da3a40a1b9d29152428', 'request_id': 'req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.383968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe59b5d4a7b4da3a40a1b9d29152428', 'request_id': 'req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.396851 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] The token cache is being invalidate because project 5fe59b5d4a7b4da3a40a1b9d29152428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:53.397140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.397776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.399281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1340/2704] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:53 2022] DELETE /identity/v3/projects/5fe59b5d4a7b4da3a40a1b9d29152428 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:53.403932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:53.413977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4eb3da-3cc1-4e70-8584-7c31bbf5d08c service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:53.477052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:53.477696 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:53.477975 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:53.478251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] PATH_INFO: `/v3/users/5d171190f1d84c77b8adb55fc6f4203f` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:53.479442 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d171190f1d84c77b8adb55fc6f4203f)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:53.482057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:53.728964 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d171190f1d84c77b8adb55fc6f4203f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.742352 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d171190f1d84c77b8adb55fc6f4203f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.743142 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d171190f1d84c77b8adb55fc6f4203f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.831078 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d171190f1d84c77b8adb55fc6f4203f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.838801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-839ae5bc-1ca4-4bc8-8a5d-72a730da3780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d171190f1d84c77b8adb55fc6f4203f'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:53.845232 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1365/2705] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:53 2022] DELETE /identity/v3/users/5d171190f1d84c77b8adb55fc6f4203f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:54.317154 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:54.318644 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:54.332229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d89a6d-db33-4ac1-bcd8-7e9d20a11c05 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:54.388796 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:54.389461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:54.389836 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:54.390109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] PATH_INFO: `/v3/projects/f439c49d25c34785876cd0ba1f2b859d` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:54.391219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f439c49d25c34785876cd0ba1f2b859d)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:54.393207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:54.483412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f439c49d25c34785876cd0ba1f2b859d', 'request_id': 'req-a9da58e6-59c3-41c6-94a4-a9864d6061ea'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:54.488933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f439c49d25c34785876cd0ba1f2b859d', 'request_id': 'req-a9da58e6-59c3-41c6-94a4-a9864d6061ea'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:54.600843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f439c49d25c34785876cd0ba1f2b859d', 'request_id': 'req-a9da58e6-59c3-41c6-94a4-a9864d6061ea'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:54.613456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] The token cache is being invalidate because project f439c49d25c34785876cd0ba1f2b859d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:54.613749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:54.618159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-a9da58e6-59c3-41c6-94a4-a9864d6061ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:54.618159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1341/2706] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:54 2022] DELETE /identity/v3/projects/f439c49d25c34785876cd0ba1f2b859d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:54.622526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524ce8-1d0d-4748-a4ec-0e49be41dd6e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:54.623010 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524ce8-1d0d-4748-a4ec-0e49be41dd6e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:54.623214 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a524ce8-1d0d-4748-a4ec-0e49be41dd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:54.655558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8a524ce8-1d0d-4748-a4ec-0e49be41dd6e None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:54.657180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8a524ce8-1d0d-4748-a4ec-0e49be41dd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:54.707931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:54.729627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1366/2707] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:54.739277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6cc72-d31d-4104-9424-b0c52bcd81e6 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:54.739563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6cc72-d31d-4104-9424-b0c52bcd81e6 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:54.745120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6cc72-d31d-4104-9424-b0c52bcd81e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:54.749270 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:54.760304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3ad6cc72-d31d-4104-9424-b0c52bcd81e6 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:54.768068 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3ad6cc72-d31d-4104-9424-b0c52bcd81e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:54.770277 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1342/2708] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:20:54.774547 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524ce8-1d0d-4748-a4ec-0e49be41dd6e None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:54.784751 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a524ce8-1d0d-4748-a4ec-0e49be41dd6e None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:54.789416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:54.790004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:54.790277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:54.790879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:54.791174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:54.791459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:54.793080 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:54.806548 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1367/2709] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:54.812524 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6cc72-d31d-4104-9424-b0c52bcd81e6 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:54.822293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6cc72-d31d-4104-9424-b0c52bcd81e6 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:54.827685 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:54.828483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:54.828766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:54.831284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:54.831284 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:54.831693 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:55.008430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1343/2710] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:54 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:55.012595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:55.023468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36331e48-cf8a-44a4-a710-36a9ae892b9f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:55.080105 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:55.080710 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.080990 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.081263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:55.081881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:55.083797 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:55.198453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1368/2711] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:55 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:55.199966 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:55.211025 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c0381-9704-40c0-b87a-5c351886db06 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:55.215658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:55.216327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.216609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.217147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:55.223367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:55.223367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:55.231069 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1344/2712] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:55.235508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:55.245930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a6c3-f40f-4554-a23b-6ab3b0b9a126 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:55.264037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e25df2-0721-4894-a2fe-747d5ad7bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:55.264037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25df2-0721-4894-a2fe-747d5ad7bdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.264037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25df2-0721-4894-a2fe-747d5ad7bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.264037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e25df2-0721-4894-a2fe-747d5ad7bdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:55.264929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e25df2-0721-4894-a2fe-747d5ad7bdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:55.264929 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e25df2-0721-4894-a2fe-747d5ad7bdd9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:55.267014 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1369/2713] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:55.271363 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:55.281632 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de3786-0734-4a61-b928-654a21b1b033 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:55.286490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:55.287142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.287420 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.287694 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] PATH_INFO: `/v3/projects/7bff8beb455748e48d2cad48ad94bf17/users/6432d461ec3149eb81faee559bebc28d/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:55.302174 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bff8beb455748e48d2cad48ad94bf17, user_id=6432d461ec3149eb81faee559bebc28d, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:55.304899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:55.372689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1345/2714] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:55 2022] PUT /identity/v3/projects/7bff8beb455748e48d2cad48ad94bf17/users/6432d461ec3149eb81faee559bebc28d/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:55.384295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617caa1d-f838-489f-887f-2091cb57b20a None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.384570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617caa1d-f838-489f-887f-2091cb57b20a None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.384841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617caa1d-f838-489f-887f-2091cb57b20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:55.422341 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-617caa1d-f838-489f-887f-2091cb57b20a None None] MFA Rules not processed for user `6432d461ec3149eb81faee559bebc28d`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:55.423579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-617caa1d-f838-489f-887f-2091cb57b20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:55.493382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1370/2715] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:55.505896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:55.507558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:55.571393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfe66b-2b1d-4e46-bb8a-2346274e058c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:55.575128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ee8d-3007-4764-992d-cec7ed4b7900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:55.575741 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ee8d-3007-4764-992d-cec7ed4b7900 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.576184 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ee8d-3007-4764-992d-cec7ed4b7900 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.577563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ee8d-3007-4764-992d-cec7ed4b7900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:55.586484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ee8d-3007-4764-992d-cec7ed4b7900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:55.588166 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ee8d-3007-4764-992d-cec7ed4b7900 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:55.597505 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1346/2716] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:55.622714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617caa1d-f838-489f-887f-2091cb57b20a None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:55.665269 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:55.690968 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617caa1d-f838-489f-887f-2091cb57b20a None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:55.695869 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:55.696614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.696974 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.697253 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] PATH_INFO: `/v3/users/6432d461ec3149eb81faee559bebc28d` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:55.698414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6432d461ec3149eb81faee559bebc28d)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:55.700669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:55.882283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6432d461ec3149eb81faee559bebc28d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:55.897938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6432d461ec3149eb81faee559bebc28d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:55.898746 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6432d461ec3149eb81faee559bebc28d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:55.957348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6432d461ec3149eb81faee559bebc28d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:55.965066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6432d461ec3149eb81faee559bebc28d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:55.977524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1371/2717] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:20:55 2022] DELETE /identity/v3/users/6432d461ec3149eb81faee559bebc28d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:55.979201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:55.979486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:55.979762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:56.010125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:56.012316 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:56.090816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1347/2718] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:56.101211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:56.102597 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:56.164866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47794e9c-2cbd-42db-98e5-4e2a0b97aa62 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:56.168578 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476600d3-ad31-4801-ac70-13098dff2593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:56.169131 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476600d3-ad31-4801-ac70-13098dff2593 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:56.169407 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476600d3-ad31-4801-ac70-13098dff2593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:56.169676 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476600d3-ad31-4801-ac70-13098dff2593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:56.178857 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476600d3-ad31-4801-ac70-13098dff2593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:56.180322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476600d3-ad31-4801-ac70-13098dff2593 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:56.190228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1372/2719] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:56.699992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:56.701581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:56.716292 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0505fa-e2fe-49cd-97e9-d9616aba83a9 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:56.721387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:56.722586 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:56.723085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:56.723429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] PATH_INFO: `/v3/projects/7bff8beb455748e48d2cad48ad94bf17` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:56.724890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bff8beb455748e48d2cad48ad94bf17)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:56.726793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:56.848063 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:56.855571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bff8beb455748e48d2cad48ad94bf17', 'request_id': 'req-890c60b0-1e12-4af7-abd0-0442e30139f2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:56.861770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bff8beb455748e48d2cad48ad94bf17', 'request_id': 'req-890c60b0-1e12-4af7-abd0-0442e30139f2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:56.926367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bff8beb455748e48d2cad48ad94bf17', 'request_id': 'req-890c60b0-1e12-4af7-abd0-0442e30139f2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:56.938222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] The token cache is being invalidate because project 7bff8beb455748e48d2cad48ad94bf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:20:56.938712 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:56.939591 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-890c60b0-1e12-4af7-abd0-0442e30139f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:20:56.941597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1348/2720] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:20:56 2022] DELETE /identity/v3/projects/7bff8beb455748e48d2cad48ad94bf17 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:56.946642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743400-3516-40ef-a84a-e19fe6b45fad None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:56.947096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743400-3516-40ef-a84a-e19fe6b45fad None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:56.947209 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc743400-3516-40ef-a84a-e19fe6b45fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:56.968087 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-dc743400-3516-40ef-a84a-e19fe6b45fad None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:56.969273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-dc743400-3516-40ef-a84a-e19fe6b45fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:57.020106 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:57.029481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1373/2721] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:57.037506 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b6f93-41e9-4547-b256-db05553baaca None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.037791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b6f93-41e9-4547-b256-db05553baaca None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.038065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b6f93-41e9-4547-b256-db05553baaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.057907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-8c3b6f93-41e9-4547-b256-db05553baaca None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:57.059118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-8c3b6f93-41e9-4547-b256-db05553baaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:57.067792 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1349/2722] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:57.072119 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743400-3516-40ef-a84a-e19fe6b45fad None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:57.082149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc743400-3516-40ef-a84a-e19fe6b45fad None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:57.087191 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:57.087789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.088101 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.088374 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.089019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:20:57.089375 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:57.091026 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:57.102505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1374/2723] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:20:57.106880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b6f93-41e9-4547-b256-db05553baaca None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:57.117406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b6f93-41e9-4547-b256-db05553baaca None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:57.123349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:57.124626 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.124922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.125229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.125848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:57.127799 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:57.263330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1350/2724] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:20:57 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:20:57.264580 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:57.275466 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cafe0-6d8a-4250-ae99-6913aad144fe admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:57.345935 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:57.346458 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.346730 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.346997 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.347666 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:57.349740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:57.432815 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1375/2725] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:20:57 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:20:57.438554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:57.449269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69281750-184e-46a4-b773-f00af489d337 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:57.454998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:57.455603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.455883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.456186 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.456835 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:57.458552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:57.473427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1351/2726] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:20:57.474793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:57.486240 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3946765-3497-41fe-a880-0bfa9d508aad admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:57.491995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929fe43-8473-4284-9b1e-4dd33311d3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:57.491995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929fe43-8473-4284-9b1e-4dd33311d3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.492203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929fe43-8473-4284-9b1e-4dd33311d3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.492349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929fe43-8473-4284-9b1e-4dd33311d3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.492976 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929fe43-8473-4284-9b1e-4dd33311d3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:57.494588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929fe43-8473-4284-9b1e-4dd33311d3b3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:57.507184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1376/2727] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:20:57.511293 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:57.521811 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5096db-e397-4481-85e6-f40a0dfc3a8c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:57.526603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:57.527207 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.527481 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.527751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] PATH_INFO: `/v3/projects/a2695de31681476c8396f89379169248/users/8c0180eebbfa49c0a161e1a5029f1089/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.544053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2695de31681476c8396f89379169248, user_id=8c0180eebbfa49c0a161e1a5029f1089, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:57.547583 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:57.664372 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1352/2728] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:20:57 2022] PUT /identity/v3/projects/a2695de31681476c8396f89379169248/users/8c0180eebbfa49c0a161e1a5029f1089/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:20:57.676221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e77b7-4272-47c7-b808-52accd5adf4e None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.676635 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e77b7-4272-47c7-b808-52accd5adf4e None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.676909 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e77b7-4272-47c7-b808-52accd5adf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.707846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-5c8e77b7-4272-47c7-b808-52accd5adf4e None None] MFA Rules not processed for user `8c0180eebbfa49c0a161e1a5029f1089`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:57.709186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-5c8e77b7-4272-47c7-b808-52accd5adf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:57.773831 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1377/2729] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:20:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:57.785122 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:57.786952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:57.843553 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e5556-e266-49a6-83e7-8dd66ee2ea0c admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:57.847182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:57.847776 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:57.848081 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:57.848351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:57.856412 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:57.857832 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:57.866879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1353/2730] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:20:58.788313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:58.788859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:58.788859 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:58.808670 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:20:58.809884 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:58.866342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:58.875273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1378/2731] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:20:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:20:59.028929 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:59.030954 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:59.102904 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9e6a5-675c-436c-b8b6-441059f5d782 service cinder] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:59.108820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d8497-c4c4-4ae0-9a08-df488f2c9561 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:59.109423 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8497-c4c4-4ae0-9a08-df488f2c9561 service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:59.109696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8497-c4c4-4ae0-9a08-df488f2c9561 service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:59.109962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8497-c4c4-4ae0-9a08-df488f2c9561 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:59.117248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:59.119725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d8497-c4c4-4ae0-9a08-df488f2c9561 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:59.121507 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d8497-c4c4-4ae0-9a08-df488f2c9561 service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:59.130085 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1354/2732] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:20:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 05:20:59.191574 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:20:59.193049 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:59.254159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ca8f-502a-4047-8921-84371c912a60 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:20:59.258486 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:20:59.259118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:20:59.259400 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:20:59.259671 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:20:59.261544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:20:59.341051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:20:59.343175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:20:59.356099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1379/2733] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:20:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:00.053960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1954e5-f5f5-4270-aa6a-4ffff7b21793 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:00.054748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1954e5-f5f5-4270-aa6a-4ffff7b21793 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:00.055024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1954e5-f5f5-4270-aa6a-4ffff7b21793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:00.076227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6d1954e5-f5f5-4270-aa6a-4ffff7b21793 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:00.077484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6d1954e5-f5f5-4270-aa6a-4ffff7b21793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:00.085247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1355/2734] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 25 05:21:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:00.097618 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:00.110827 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fb799-3aad-479e-8655-0e8dbb412d2e service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:00.116681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:00.117288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:00.117747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:00.118021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:00.127431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:00.129285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:00.138700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1380/2735] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:21:00.821558 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11a03a-93e1-4151-9de3-74dd7a835edf None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:00.822103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11a03a-93e1-4151-9de3-74dd7a835edf None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:00.822561 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11a03a-93e1-4151-9de3-74dd7a835edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:00.852262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-5c11a03a-93e1-4151-9de3-74dd7a835edf None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:00.853729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-5c11a03a-93e1-4151-9de3-74dd7a835edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:00.867236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1356/2736] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:21:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:00.881583 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:00.894628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3912d0-9d12-48a7-8760-3188d7bb42cb service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:00.901877 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:00.903249 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:00.903789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:00.904393 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:00.915970 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:00.917697 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:00.927972 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1381/2737] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:21:01.828882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:01.829689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:01.830160 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:01.867328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:01.868974 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:01.878219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1357/2738] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 25 05:21:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:01.890904 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:01.913947 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcb26a-66d3-4bd5-8cbf-3e5a7e590ea4 service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:01.923512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5410-3136-43e3-b2e7-0f53c6b6ae8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:01.924431 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5410-3136-43e3-b2e7-0f53c6b6ae8e service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:01.925568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5410-3136-43e3-b2e7-0f53c6b6ae8e service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:01.926045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5410-3136-43e3-b2e7-0f53c6b6ae8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:01.939233 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5410-3136-43e3-b2e7-0f53c6b6ae8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:01.941978 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5410-3136-43e3-b2e7-0f53c6b6ae8e service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:01.954849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1382/2739] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:21:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:21:04.747490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:04.751206 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:04.822341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e2022-41b2-462c-b960-be3bf638ae34 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:04.829981 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:04.830629 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:04.830919 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:04.831183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] PATH_INFO: `/v3/users/9b6fa5d6022a48298debc2d174fef889` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:04.832375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6fa5d6022a48298debc2d174fef889)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:04.834522 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:05.107550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6fa5d6022a48298debc2d174fef889'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:05.107550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6fa5d6022a48298debc2d174fef889'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:05.107550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6fa5d6022a48298debc2d174fef889'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:05.402782 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6fa5d6022a48298debc2d174fef889'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:05.413135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6fa5d6022a48298debc2d174fef889'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:05.445969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1358/2740] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:21:04 2022] DELETE /identity/v3/users/9b6fa5d6022a48298debc2d174fef889 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:05.452135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:05.452135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:05.452135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:05.482395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:05.484493 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:05.549324 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1383/2741] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:05.558729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:05.563235 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:05.625704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd4ba4-fc59-43aa-8dfd-a51e38ed2b42 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:05.629436 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:05.630034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:05.630485 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:05.630588 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:05.639854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:05.641311 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:05.645143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:05.651093 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1359/2742] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:05.922800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:05.928497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:05.950541 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226d821-f139-41e7-879a-607b8d7389bc None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:05.956254 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:05.956888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:05.957212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:05.957484 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] PATH_INFO: `/v3/projects/4f67ae0a3ccc40e6b32bf78b9711a104` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:05.958705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f67ae0a3ccc40e6b32bf78b9711a104)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:05.960656 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:05.970223 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=100 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:06.137835 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f67ae0a3ccc40e6b32bf78b9711a104', 'request_id': 'req-d6978114-4314-491a-9a76-b92b3a298cc5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:06.144542 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f67ae0a3ccc40e6b32bf78b9711a104', 'request_id': 'req-d6978114-4314-491a-9a76-b92b3a298cc5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:06.235339 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f67ae0a3ccc40e6b32bf78b9711a104', 'request_id': 'req-d6978114-4314-491a-9a76-b92b3a298cc5'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:06.253776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] The token cache is being invalidate because project 4f67ae0a3ccc40e6b32bf78b9711a104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:21:06.253776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:06.253776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:06.253776 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1384/2743] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:21:05 2022] DELETE /identity/v3/projects/4f67ae0a3ccc40e6b32bf78b9711a104 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:06.854076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:06.863879 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7b69a-d0ed-4270-b544-b798a0a268c4 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:06.912237 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bfa54-7d3d-439d-84d0-52355aa547f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:06.912844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfa54-7d3d-439d-84d0-52355aa547f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:06.913120 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfa54-7d3d-439d-84d0-52355aa547f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:06.913389 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bfa54-7d3d-439d-84d0-52355aa547f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:06.915159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-eb9bfa54-7d3d-439d-84d0-52355aa547f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:06.982222 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bfa54-7d3d-439d-84d0-52355aa547f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:06.984367 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bfa54-7d3d-439d-84d0-52355aa547f3 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:06.994281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1360/2744] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:09.872516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:09.874499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:09.887285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6978114-4314-491a-9a76-b92b3a298cc5 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:09.892255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:09.893032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:09.893855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:09.893855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] PATH_INFO: `/v3/users/8c0180eebbfa49c0a161e1a5029f1089` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:09.894737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0180eebbfa49c0a161e1a5029f1089)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:09.896770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:10.150122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0180eebbfa49c0a161e1a5029f1089'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:10.169050 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0180eebbfa49c0a161e1a5029f1089'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:10.171040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0180eebbfa49c0a161e1a5029f1089'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:10.304822 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0180eebbfa49c0a161e1a5029f1089'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:10.325414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0180eebbfa49c0a161e1a5029f1089'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:10.334245 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1385/2745] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:21:09 2022] DELETE /identity/v3/users/8c0180eebbfa49c0a161e1a5029f1089 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:21:10.338533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:10.339329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:10.339329 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:10.374079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:10.381158 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:10.462028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1361/2746] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:21:10.473122 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:10.475926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:10.540875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e886d-d815-4050-b421-174b065358cb admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:10.546966 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:10.547650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:10.547949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:10.548228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:10.559432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:10.560944 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:10.573523 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1386/2747] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:10.924264 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:10.929460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:10.988402 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:11.012573 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535064a-add7-49f6-973c-1e99aa949a6b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:11.017722 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f778e-bf2c-44cc-85da-48c993a116c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:11.018273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f778e-bf2c-44cc-85da-48c993a116c8 service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.018551 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f778e-bf2c-44cc-85da-48c993a116c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.018824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f778e-bf2c-44cc-85da-48c993a116c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.020581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e39f778e-bf2c-44cc-85da-48c993a116c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:11.032516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f778e-bf2c-44cc-85da-48c993a116c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:11.034105 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f778e-bf2c-44cc-85da-48c993a116c8 service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:11.043744 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1362/2748] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:21:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:11.164811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:11.176373 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:11.183039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542268-702a-4710-a415-c4a730edd518 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:11.188327 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:11.189032 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.189381 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.189723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] PATH_INFO: `/v3/projects/a2695de31681476c8396f89379169248` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.190953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2695de31681476c8396f89379169248)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:11.193036 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:11.201705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:11.362389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2695de31681476c8396f89379169248', 'request_id': 'req-aebec7aa-9e70-4f52-bc55-aacdccaf1123'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:11.368773 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2695de31681476c8396f89379169248', 'request_id': 'req-aebec7aa-9e70-4f52-bc55-aacdccaf1123'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:11.463669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2695de31681476c8396f89379169248', 'request_id': 'req-aebec7aa-9e70-4f52-bc55-aacdccaf1123'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:11.478652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] The token cache is being invalidate because project a2695de31681476c8396f89379169248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:21:11.478955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:11.479673 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-aebec7aa-9e70-4f52-bc55-aacdccaf1123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:11.483149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1387/2749] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:21:11 2022] DELETE /identity/v3/projects/a2695de31681476c8396f89379169248 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:11.488534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24b93-7274-47e6-a7f9-ab6993ef76bc None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.489340 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24b93-7274-47e6-a7f9-ab6993ef76bc None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.489620 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24b93-7274-47e6-a7f9-ab6993ef76bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.509831 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-49d24b93-7274-47e6-a7f9-ab6993ef76bc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:11.511053 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-49d24b93-7274-47e6-a7f9-ab6993ef76bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:11.571605 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1363/2750] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:11.580210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075d41d-1d29-4b28-896d-eabaff12eb91 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.580499 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075d41d-1d29-4b28-896d-eabaff12eb91 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.580778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075d41d-1d29-4b28-896d-eabaff12eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.600874 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-d075d41d-1d29-4b28-896d-eabaff12eb91 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:11.602113 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d075d41d-1d29-4b28-896d-eabaff12eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:11.611702 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1388/2751] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:21:11.619082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d24b93-7274-47e6-a7f9-ab6993ef76bc None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:11.626336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d24b93-7274-47e6-a7f9-ab6993ef76bc None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:11.631083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:11.631689 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.632012 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.632286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.632936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:21:11.633302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:11.634848 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:11.647705 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1364/2752] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:21:11.652027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075d41d-1d29-4b28-896d-eabaff12eb91 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:11.662305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075d41d-1d29-4b28-896d-eabaff12eb91 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:11.667220 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:11.667836 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.668148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.668428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.669057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:11.671201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:11.768316 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1389/2753] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:21:11 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:21:11.773076 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:11.783743 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be28e-2c4e-4f6d-91e7-232758f6a2b8 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:11.840765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:11.841378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.841659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.842453 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.843251 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:11.845281 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:11.927733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1365/2754] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:21:11 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:21:11.931512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:11.942066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfd4f4-2d46-4757-ade4-98308a9e20d5 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:11.946814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:11.952202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.952202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.952202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.952202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:11.952202 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:11.960916 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1390/2755] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:21:11.965033 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:11.975794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26502805-0ced-4cfa-ab92-36d9e7b5f981 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:11.980408 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02be0f-ee46-44ed-857a-feaa5d18b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:11.980994 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02be0f-ee46-44ed-857a-feaa5d18b9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:11.981268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02be0f-ee46-44ed-857a-feaa5d18b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:11.983055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02be0f-ee46-44ed-857a-feaa5d18b9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:11.983055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02be0f-ee46-44ed-857a-feaa5d18b9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:11.984517 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02be0f-ee46-44ed-857a-feaa5d18b9c9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:11.995633 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1366/2756] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:21:11.999924 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:12.009854 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b8c95-bb4c-4f11-a0f2-1fdcc11018a1 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:12.015451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:12.016118 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:12.017149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:12.017149 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] PATH_INFO: `/v3/projects/47267746a909485caf0bcd4155cec727/users/7620746f017c41a29e57d085c3cfbaa1/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:12.031753 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47267746a909485caf0bcd4155cec727, user_id=7620746f017c41a29e57d085c3cfbaa1, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:12.034465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:12.131382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1391/2757] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:21:11 2022] PUT /identity/v3/projects/47267746a909485caf0bcd4155cec727/users/7620746f017c41a29e57d085c3cfbaa1/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:12.137359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:12.137751 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:12.138123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:12.180793 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:12.182313 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:12.243820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:12.267128 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1367/2758] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:12.281189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:12.281189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:12.343855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1f3b2-a3b4-441f-af9e-dbf3702c146b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:12.345849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:12.346459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:12.346734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:12.347029 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:12.357172 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:12.358605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:12.369210 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1392/2759] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:15.619483 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:15.621136 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:15.646697 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda9ced-1d0d-452e-97a0-e4072c32e034 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:15.654118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:15.654892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:15.655341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:15.655716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] PATH_INFO: `/v3/users/6e30b4b9387841cdafec55e713085244` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:15.657030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e30b4b9387841cdafec55e713085244)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:15.659176 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:15.990914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e30b4b9387841cdafec55e713085244'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:15.991775 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e30b4b9387841cdafec55e713085244'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:15.992639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e30b4b9387841cdafec55e713085244'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.097868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e30b4b9387841cdafec55e713085244'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.105770 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e30b4b9387841cdafec55e713085244'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.127141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1368/2760] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:21:15 2022] DELETE /identity/v3/users/6e30b4b9387841cdafec55e713085244 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:16.446235 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:16.458582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3c7f2-4865-483b-b2d3-386950117cdb service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:16.494027 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:16.525354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:16.526110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:16.526453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:16.526830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] PATH_INFO: `/v3/projects/4f9ccb4755bf494592ec9e3114555111` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:16.528228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9ccb4755bf494592ec9e3114555111)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:16.532075 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:16.688459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9ccb4755bf494592ec9e3114555111', 'request_id': 'req-fc0d185d-65d8-4957-b3fb-fec90cebb356'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.695544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9ccb4755bf494592ec9e3114555111', 'request_id': 'req-fc0d185d-65d8-4957-b3fb-fec90cebb356'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.783925 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9ccb4755bf494592ec9e3114555111', 'request_id': 'req-fc0d185d-65d8-4957-b3fb-fec90cebb356'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.796594 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] The token cache is being invalidate because project 4f9ccb4755bf494592ec9e3114555111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:21:16.797104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.797814 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:16.799557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1393/2761] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:21:16 2022] DELETE /identity/v3/projects/4f9ccb4755bf494592ec9e3114555111 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:16.803739 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:16.805297 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:16.819871 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6887de-c74c-41dc-9e79-cf263becb5ec admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:16.889590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:16.890336 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:16.890614 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:16.890885 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] PATH_INFO: `/v3/users/74d8c0fdbfc740b1a065513b346506f7` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:16.892130 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d8c0fdbfc740b1a065513b346506f7)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:16.894134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:17.145968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d8c0fdbfc740b1a065513b346506f7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:17.146724 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d8c0fdbfc740b1a065513b346506f7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:17.147354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d8c0fdbfc740b1a065513b346506f7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:17.242039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d8c0fdbfc740b1a065513b346506f7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:17.247494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:17.252061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-1c317d6b-dde7-4109-9f5f-e9c2917945bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d8c0fdbfc740b1a065513b346506f7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:17.272172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1369/2762] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:21:16 2022] DELETE /identity/v3/users/74d8c0fdbfc740b1a065513b346506f7 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:17.565059 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:17.567474 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:17.602485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d185d-65d8-4957-b3fb-fec90cebb356 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:17.729298 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:17.730127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:17.730478 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:17.730996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] PATH_INFO: `/v3/projects/789ef79efd2d48a6bbcb168fdd5e8bcb` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:17.732816 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=789ef79efd2d48a6bbcb168fdd5e8bcb)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:17.734878 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:17.903750 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789ef79efd2d48a6bbcb168fdd5e8bcb', 'request_id': 'req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:17.917611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789ef79efd2d48a6bbcb168fdd5e8bcb', 'request_id': 'req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:18.058469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789ef79efd2d48a6bbcb168fdd5e8bcb', 'request_id': 'req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:18.081385 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:18.104948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] The token cache is being invalidate because project 789ef79efd2d48a6bbcb168fdd5e8bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:21:18.105243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:18.106098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:21:18.114090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1394/2763] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:21:17 2022] DELETE /identity/v3/projects/789ef79efd2d48a6bbcb168fdd5e8bcb => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:18.707844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b01f90-a166-46f0-ac4d-ba818c665e6b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:18.708349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b01f90-a166-46f0-ac4d-ba818c665e6b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:18.708913 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b01f90-a166-46f0-ac4d-ba818c665e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:18.741487 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-14b01f90-a166-46f0-ac4d-ba818c665e6b None None] MFA Rules not processed for user `7620746f017c41a29e57d085c3cfbaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:18.742834 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-14b01f90-a166-46f0-ac4d-ba818c665e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:18.806542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1370/2764] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:18.811177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:18.812609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:18.877035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b78e32-1f1d-40e8-8906-c8a6e078c77b admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:18.881744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:18.882345 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:18.882626 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:18.882899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:18.883526 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:18.885479 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:18.969353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1395/2765] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:21:18 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:21:18.973387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b01f90-a166-46f0-ac4d-ba818c665e6b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:18.984521 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b01f90-a166-46f0-ac4d-ba818c665e6b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:19.046532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:19.047152 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:19.047430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:19.047701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:19.048379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:19.050301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:19.162781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1371/2766] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:21:18 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:21:19.167251 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:19.178135 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141cbca-ba46-4438-a4a2-8d2e4ec2afe5 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:19.182866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:19.183456 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:19.183733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:19.184037 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:19.184674 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:19.186949 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:19.196907 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1396/2767] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:21:19.201602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:19.211937 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfd684-f4c8-415c-a858-a4ee5efce9bf admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:19.216978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:19.217655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:19.217933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:19.219535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] PATH_INFO: `/v3/projects/c347a0f3f37d42f1a5058bf07e1467ee/users/9741ce8f47c64f9ca3e566b65ae27d05/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:19.238373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c347a0f3f37d42f1a5058bf07e1467ee, user_id=9741ce8f47c64f9ca3e566b65ae27d05, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:19.241956 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:19.356899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1372/2768] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:21:19 2022] PUT /identity/v3/projects/c347a0f3f37d42f1a5058bf07e1467ee/users/9741ce8f47c64f9ca3e566b65ae27d05/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:21:19.361021 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:19.371765 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3478da-f7f5-4aac-8c61-e983b1f2dca9 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:19.431622 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d415bc-5eaf-43ed-b74e-a9b8d08e6cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:19.432260 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d415bc-5eaf-43ed-b74e-a9b8d08e6cda admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:19.432535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d415bc-5eaf-43ed-b74e-a9b8d08e6cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:19.432803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d415bc-5eaf-43ed-b74e-a9b8d08e6cda admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:19.433440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d415bc-5eaf-43ed-b74e-a9b8d08e6cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:19.435034 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d415bc-5eaf-43ed-b74e-a9b8d08e6cda admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:19.445991 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1397/2769] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:21:19.449962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:19.460955 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04e28b-4f27-4697-8c2b-e32cead446ce admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:19.465575 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:19.466218 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:19.466511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:19.466804 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] PATH_INFO: `/v3/projects/c347a0f3f37d42f1a5058bf07e1467ee/users/9741ce8f47c64f9ca3e566b65ae27d05/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:19.468731 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c347a0f3f37d42f1a5058bf07e1467ee, user_id=9741ce8f47c64f9ca3e566b65ae27d05, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:19.471348 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:19.481664 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1373/2770] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:21:19 2022] PUT /identity/v3/projects/c347a0f3f37d42f1a5058bf07e1467ee/users/9741ce8f47c64f9ca3e566b65ae27d05/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:21:25.056110 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61052429-4e97-42a8-9cef-2503e0c02331 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:25.056689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61052429-4e97-42a8-9cef-2503e0c02331 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:25.056689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61052429-4e97-42a8-9cef-2503e0c02331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:25.088162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-61052429-4e97-42a8-9cef-2503e0c02331 None None] MFA Rules not processed for user `9741ce8f47c64f9ca3e566b65ae27d05`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:25.089411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-61052429-4e97-42a8-9cef-2503e0c02331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:25.143630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:25.162938 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1398/2771] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:25.176198 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:25.177979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:25.201390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:25.250608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0072db-bfcd-49b2-9792-2f7e643356f1 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:25.254465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ce4f6719f9b47dda69cc67ed74b45f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:25.255077 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:25.255357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:25.255627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:25.320886 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:25.322438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:25.332963 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1374/2772] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:21:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:25.597646 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f043-2475-4d91-a45e-ebd2d9ddc45f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:25.597932 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f043-2475-4d91-a45e-ebd2d9ddc45f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:25.598201 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724f043-2475-4d91-a45e-ebd2d9ddc45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:25.618539 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-8724f043-2475-4d91-a45e-ebd2d9ddc45f None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:25.619749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-8724f043-2475-4d91-a45e-ebd2d9ddc45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:25.678429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1399/2773] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:21:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:25.690746 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:25.692182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:25.761868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e928-b5e1-48e2-a278-921f54dfa1ee service glance] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:25.767714 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d75e-4fa9-4dcb-bda0-f0b926786699 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:25.768386 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d75e-4fa9-4dcb-bda0-f0b926786699 service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:25.768663 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d75e-4fa9-4dcb-bda0-f0b926786699 service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:25.768936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d75e-4fa9-4dcb-bda0-f0b926786699 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:25.777234 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d75e-4fa9-4dcb-bda0-f0b926786699 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:25.779526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d75e-4fa9-4dcb-bda0-f0b926786699 service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:25.788533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1375/2774] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:21:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:21:35.671584 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=30 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:35.742764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae39de-2b67-447e-a039-311eab0b6567 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:35.743103 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae39de-2b67-447e-a039-311eab0b6567 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:35.743386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae39de-2b67-447e-a039-311eab0b6567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:35.762608 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-3bae39de-2b67-447e-a039-311eab0b6567 None None] MFA Rules not processed for user `7620746f017c41a29e57d085c3cfbaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:35.764452 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-3bae39de-2b67-447e-a039-311eab0b6567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:35.771342 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1400/2775] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:21:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:35.785261 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=72 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:39.316887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:39.317486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:39.317486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:39.352034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:21:39.352034 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:39.405172 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1376/2776] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:21:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:21:39.417435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae39de-2b67-447e-a039-311eab0b6567 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:39.453790 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae39de-2b67-447e-a039-311eab0b6567 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:39.458799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:39.459386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:39.459660 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:39.459973 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:39.469114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:39.473438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:39.479386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1401/2777] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:21:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:21:48.124698 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:21:48.126155 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:48.226260 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7435d9e-d6f5-4964-bd48-722c51c45c67 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:21:48.231838 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e57aa-f350-457a-8faf-c4e12a28a4ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:21:48.232550 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e57aa-f350-457a-8faf-c4e12a28a4ce service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:21:48.232847 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e57aa-f350-457a-8faf-c4e12a28a4ce service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:21:48.233117 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e57aa-f350-457a-8faf-c4e12a28a4ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:21:48.235125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-dd4e57aa-f350-457a-8faf-c4e12a28a4ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:21:48.247999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e57aa-f350-457a-8faf-c4e12a28a4ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:21:48.249602 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e57aa-f350-457a-8faf-c4e12a28a4ce service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:21:48.260461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1377/2778] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:21:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:21:49.475900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=20 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:58.255601 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=60 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:03.609995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:22:03.611417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:22:03.692181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df737d9b-d83e-4631-9631-01f31057680b service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:22:03.695813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:22:03.696451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:22:03.696771 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:22:03.697045 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:22:03.707804 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:22:03.709283 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:22:03.719481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1402/2779] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:22:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:22:13.714894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=35 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:28.593114 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1315-2754-4367-bd9e-d9b9516af580 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:28.593582 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1315-2754-4367-bd9e-d9b9516af580 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:28.593696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b1315-2754-4367-bd9e-d9b9516af580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:28.622773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-642b1315-2754-4367-bd9e-d9b9516af580 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:23:28.623997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-642b1315-2754-4367-bd9e-d9b9516af580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:28.631361 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1378/2780] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 25 05:23:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:23:28.671675 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:23:28.683022 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa60f-4b42-4ab1-9904-64a08f09f3fd service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:23:28.688242 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:23:28.688841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:28.689117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:28.689387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:28.699066 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:23:28.700698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:23:28.711401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1403/2781] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:23:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:37.228678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b1315-2754-4367-bd9e-d9b9516af580 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:23:37.312138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b1315-2754-4367-bd9e-d9b9516af580 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:23:37.317640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:23:37.318272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:37.318554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:37.318830 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] PATH_INFO: `/v3/users/7620746f017c41a29e57d085c3cfbaa1` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:37.320011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7620746f017c41a29e57d085c3cfbaa1)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:23:37.321949 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:23:37.595655 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7620746f017c41a29e57d085c3cfbaa1'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:37.596232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7620746f017c41a29e57d085c3cfbaa1'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:37.596829 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7620746f017c41a29e57d085c3cfbaa1'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:37.707976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7620746f017c41a29e57d085c3cfbaa1'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:37.715765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7620746f017c41a29e57d085c3cfbaa1'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:37.733603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1379/2782] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:23:37 2022] DELETE /identity/v3/users/7620746f017c41a29e57d085c3cfbaa1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:23:38.056093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:23:38.056093 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad7a4c-f1e9-4e7b-a4b9-96bd6c2867fa service swift] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:23:38.117758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:23:38.117758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:38.117758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:38.117758 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] PATH_INFO: `/v3/projects/47267746a909485caf0bcd4155cec727` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:38.118229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47267746a909485caf0bcd4155cec727)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:23:38.118229 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:23:38.273550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47267746a909485caf0bcd4155cec727', 'request_id': 'req-b6c8b4aa-3e02-4c99-b510-0a455b76625a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.279739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47267746a909485caf0bcd4155cec727', 'request_id': 'req-b6c8b4aa-3e02-4c99-b510-0a455b76625a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.353198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47267746a909485caf0bcd4155cec727', 'request_id': 'req-b6c8b4aa-3e02-4c99-b510-0a455b76625a'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.376551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] The token cache is being invalidate because project 47267746a909485caf0bcd4155cec727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:23:38.376770 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.377398 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.379411 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1404/2783] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:23:38 2022] DELETE /identity/v3/projects/47267746a909485caf0bcd4155cec727 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:23:38.383673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:23:38.385139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:38.398979 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14264ff-4d6f-4389-a097-131eb54f5ff2 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:23:38.441082 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:38.454096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:23:38.454721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:38.454997 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:38.455269 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] PATH_INFO: `/v3/users/9741ce8f47c64f9ca3e566b65ae27d05` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:38.456465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9741ce8f47c64f9ca3e566b65ae27d05)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:23:38.458445 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:23:38.680807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9741ce8f47c64f9ca3e566b65ae27d05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.681407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9741ce8f47c64f9ca3e566b65ae27d05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.682024 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9741ce8f47c64f9ca3e566b65ae27d05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.758774 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9741ce8f47c64f9ca3e566b65ae27d05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.766244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9741ce8f47c64f9ca3e566b65ae27d05'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:38.783460 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1380/2784] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:23:38 2022] DELETE /identity/v3/users/9741ce8f47c64f9ca3e566b65ae27d05 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:23:39.064718 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:23:39.066549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:39.081591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8b4aa-3e02-4c99-b510-0a455b76625a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:23:39.144502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:23:39.145115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:39.145395 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:39.145669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] PATH_INFO: `/v3/projects/c347a0f3f37d42f1a5058bf07e1467ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:39.146892 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c347a0f3f37d42f1a5058bf07e1467ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:23:39.148862 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:23:39.156686 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:39.257387 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c347a0f3f37d42f1a5058bf07e1467ee', 'request_id': 'req-76465e21-6f93-4f12-b089-ffe63c0e6f63'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:39.263525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c347a0f3f37d42f1a5058bf07e1467ee', 'request_id': 'req-76465e21-6f93-4f12-b089-ffe63c0e6f63'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:39.353810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c347a0f3f37d42f1a5058bf07e1467ee', 'request_id': 'req-76465e21-6f93-4f12-b089-ffe63c0e6f63'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:39.365520 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] The token cache is being invalidate because project c347a0f3f37d42f1a5058bf07e1467ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:23:39.366052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:39.367116 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:23:39.368783 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1405/2785] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:23:39 2022] DELETE /identity/v3/projects/c347a0f3f37d42f1a5058bf07e1467ee => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:23:41.254143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:23:41.255735 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:41.313884 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43b4b-ed5a-4c33-9892-cd756dbaf646 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:23:41.363107 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d94d7c-9095-4016-9bfb-044b2ecf568f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:23:41.363645 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d94d7c-9095-4016-9bfb-044b2ecf568f service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:41.363957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d94d7c-9095-4016-9bfb-044b2ecf568f service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:41.364236 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d94d7c-9095-4016-9bfb-044b2ecf568f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:41.366227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-39d94d7c-9095-4016-9bfb-044b2ecf568f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:41.404121 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:41.448725 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d94d7c-9095-4016-9bfb-044b2ecf568f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:23:41.450171 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d94d7c-9095-4016-9bfb-044b2ecf568f service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:23:41.470334 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1381/2786] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:23:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:23:42.648562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:23:42.650013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:42.662755 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465e21-6f93-4f12-b089-ffe63c0e6f63 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:23:42.666313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:23:42.666901 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:42.667174 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:42.667441 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:42.669085 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:42.682404 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:23:42.683853 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:23:42.695311 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1406/2787] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:23:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:23:50.863261 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:23:50.863749 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:23:50.863865 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:23:50.885045 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] MFA Rules not processed for user `4168274f7ad04add802a472fc772f806`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:23:50.886267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:23:50.939860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1382/2788] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:23:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:23:52.690162 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:00.933123 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=51 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:10.114829 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:24:10.117506 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:24:10.129051 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47277c-5ec8-4dd7-a1cf-9eb66c380386 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:24:10.133517 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:24:10.134120 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:24:10.136922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:24:10.136922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:24:10.136922 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:24:10.151505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:24:10.153007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:24:10.161439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1407/2789] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:24:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:24:20.157747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=6 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:04.917009 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:04.918537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:04.936718 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee6bb1-5ab7-4ba1-b58d-88b81405389b None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:04.942302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:04.942908 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:04.943183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:04.943447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:04.945161 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:04.958380 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:04.960092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:04.972074 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1383/2790] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:14.967384 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=6 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:15.410601 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:15.412167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:15.480817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b1091-efd2-4303-a58c-562ad54b90d5 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:15.486279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:15.486898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:15.487173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:15.487498 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] PATH_INFO: `/v3/users/4168274f7ad04add802a472fc772f806` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:15.488700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4168274f7ad04add802a472fc772f806)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:15.490628 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:15.640429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4168274f7ad04add802a472fc772f806'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:15.652439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4168274f7ad04add802a472fc772f806'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:15.653123 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4168274f7ad04add802a472fc772f806'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:15.700307 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4168274f7ad04add802a472fc772f806'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:15.710204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-82f68272-934d-4903-8d4f-04a9c321a87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4168274f7ad04add802a472fc772f806'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:15.716156 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1408/2791] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:25:15 2022] DELETE /identity/v3/users/4168274f7ad04add802a472fc772f806 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:15.962456 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:15.978318 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c0c19-64f2-4ca7-b7c7-6fa40e5e92d0 service nova] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:16.035240 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:16.035868 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.036285 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.036567 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] PATH_INFO: `/v3/projects/6ae05660d84743a982e2dca4caba08c6` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.037691 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae05660d84743a982e2dca4caba08c6)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:16.039615 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:16.169215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae05660d84743a982e2dca4caba08c6', 'request_id': 'req-46e87c15-8a00-43b7-af50-434519132973'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:16.174883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae05660d84743a982e2dca4caba08c6', 'request_id': 'req-46e87c15-8a00-43b7-af50-434519132973'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:16.266920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae05660d84743a982e2dca4caba08c6', 'request_id': 'req-46e87c15-8a00-43b7-af50-434519132973'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:16.278611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] The token cache is being invalidate because project 6ae05660d84743a982e2dca4caba08c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:25:16.278905 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:16.279532 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-46e87c15-8a00-43b7-af50-434519132973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:16.281078 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1384/2792] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:25:15 2022] DELETE /identity/v3/projects/6ae05660d84743a982e2dca4caba08c6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:16.286320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560809dc-00e4-4ca7-a74f-edb51dc18d92 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.286630 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560809dc-00e4-4ca7-a74f-edb51dc18d92 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.286872 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560809dc-00e4-4ca7-a74f-edb51dc18d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.345873 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-560809dc-00e4-4ca7-a74f-edb51dc18d92 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:16.347082 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-560809dc-00e4-4ca7-a74f-edb51dc18d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:16.390508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:16.406195 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1409/2793] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:16.414860 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f041cc-2009-472e-a716-7b95e107f930 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.415144 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f041cc-2009-472e-a716-7b95e107f930 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.415419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f041cc-2009-472e-a716-7b95e107f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.436425 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-f8f041cc-2009-472e-a716-7b95e107f930 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:16.437639 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-f8f041cc-2009-472e-a716-7b95e107f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:16.446882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1385/2794] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:16.451117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560809dc-00e4-4ca7-a74f-edb51dc18d92 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:16.461550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560809dc-00e4-4ca7-a74f-edb51dc18d92 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:16.466288 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:16.468203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.468203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.468203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.468203 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:25:16.468589 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:16.470112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:16.481438 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1410/2795] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:25:16.486612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f041cc-2009-472e-a716-7b95e107f930 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:16.496007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f041cc-2009-472e-a716-7b95e107f930 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:16.501417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:16.502032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.502387 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.502661 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.503287 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:16.506390 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:16.646567 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1386/2796] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:25:16 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:25:16.650615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:16.661463 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56309f-36b9-40ba-a675-c3024bdb8771 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:16.720365 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:16.720987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.721267 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.721543 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.722183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:16.724216 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:16.838166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1411/2797] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:25:16 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:16.842232 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:16.852917 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13b274-41b5-494b-ba74-bc7c15a4847d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:16.857690 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:16.858243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.858523 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.858797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.859439 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:16.861083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:16.871477 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1387/2798] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:16.876761 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:16.887168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03286d2-8008-4e6e-96b3-641e682c4396 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:16.892562 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e66f34-4271-450d-abf5-c5cc023704b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:16.893155 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66f34-4271-450d-abf5-c5cc023704b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.893434 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66f34-4271-450d-abf5-c5cc023704b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.893705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66f34-4271-450d-abf5-c5cc023704b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.894343 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e66f34-4271-450d-abf5-c5cc023704b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:16.895982 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e66f34-4271-450d-abf5-c5cc023704b8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:16.906454 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1412/2799] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:16.911140 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:16.921148 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cfced-382a-43c9-8c94-b450b1510091 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:16.926365 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:16.927011 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:16.927286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:16.927560 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] PATH_INFO: `/v3/projects/dea221cde75b403380f7335cd0bb0010/users/a57228e1b77b474ebdd2d009ede5ed93/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:16.942185 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea221cde75b403380f7335cd0bb0010, user_id=a57228e1b77b474ebdd2d009ede5ed93, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:16.944874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:17.020854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1388/2800] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:25:16 2022] PUT /identity/v3/projects/dea221cde75b403380f7335cd0bb0010/users/a57228e1b77b474ebdd2d009ede5ed93/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:17.033143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12fee3-6181-4387-a3ae-e69816bba6fe None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:17.033425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12fee3-6181-4387-a3ae-e69816bba6fe None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:17.033744 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12fee3-6181-4387-a3ae-e69816bba6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:17.061838 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7f12fee3-6181-4387-a3ae-e69816bba6fe None None] MFA Rules not processed for user `a57228e1b77b474ebdd2d009ede5ed93`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:17.063068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7f12fee3-6181-4387-a3ae-e69816bba6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:17.129068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1413/2801] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:17.140127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:17.142435 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:17.164915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:17.218115 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d0e92-62e1-4ce5-afc0-38f9b3b424db admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:17.224371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5ced9-ff8a-4cbb-9b72-fcb541ceeb75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:17.224971 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5ced9-ff8a-4cbb-9b72-fcb541ceeb75 service nova] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:17.225244 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5ced9-ff8a-4cbb-9b72-fcb541ceeb75 service nova] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:17.225516 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5ced9-ff8a-4cbb-9b72-fcb541ceeb75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:17.233219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5ced9-ff8a-4cbb-9b72-fcb541ceeb75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:17.234822 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5ced9-ff8a-4cbb-9b72-fcb541ceeb75 service nova] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:17.243998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1389/2802] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:23.282320 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12fee3-6181-4387-a3ae-e69816bba6fe None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:23.325801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:23.342587 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12fee3-6181-4387-a3ae-e69816bba6fe None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:23.347606 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:23.350124 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:23.350402 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:23.350672 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] PATH_INFO: `/v3/users/a57228e1b77b474ebdd2d009ede5ed93` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:23.351801 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57228e1b77b474ebdd2d009ede5ed93)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:23.353740 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:23.547086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57228e1b77b474ebdd2d009ede5ed93'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:23.558721 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57228e1b77b474ebdd2d009ede5ed93'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:23.559382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57228e1b77b474ebdd2d009ede5ed93'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:23.642701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57228e1b77b474ebdd2d009ede5ed93'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:23.651536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57228e1b77b474ebdd2d009ede5ed93'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:23.657360 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1414/2803] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:25:23 2022] DELETE /identity/v3/users/a57228e1b77b474ebdd2d009ede5ed93 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:23.661978 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:23.667855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:23.667855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:23.681877 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:23.683079 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:23.740891 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1390/2804] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:23.750846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:23.752275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:23.810004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a14f-f8fc-44ad-b071-b181458d340e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:23.813605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d06a8-d404-47db-8f58-2d853e70fe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:23.814206 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d06a8-d404-47db-8f58-2d853e70fe06 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:23.814485 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d06a8-d404-47db-8f58-2d853e70fe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:23.814760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d06a8-d404-47db-8f58-2d853e70fe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:23.824522 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d06a8-d404-47db-8f58-2d853e70fe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:23.825966 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d06a8-d404-47db-8f58-2d853e70fe06 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:23.835631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1415/2805] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:24.290660 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:24.292379 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:24.306846 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b6140-36f9-4bae-a582-a63e9029d5b3 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:24.311609 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:24.312267 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.315820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.315820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] PATH_INFO: `/v3/projects/dea221cde75b403380f7335cd0bb0010` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.315820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea221cde75b403380f7335cd0bb0010)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:24.315820 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:24.447499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea221cde75b403380f7335cd0bb0010', 'request_id': 'req-8df0756f-2b80-496b-919a-3930a8fb6e79'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:24.452914 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea221cde75b403380f7335cd0bb0010', 'request_id': 'req-8df0756f-2b80-496b-919a-3930a8fb6e79'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:24.515627 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea221cde75b403380f7335cd0bb0010', 'request_id': 'req-8df0756f-2b80-496b-919a-3930a8fb6e79'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:24.527471 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] The token cache is being invalidate because project dea221cde75b403380f7335cd0bb0010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:25:24.527759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:24.528482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8df0756f-2b80-496b-919a-3930a8fb6e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:24.529960 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1391/2806] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:25:24 2022] DELETE /identity/v3/projects/dea221cde75b403380f7335cd0bb0010 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:24.535700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b6e34-f5da-4acb-bbe1-c9b12cf82949 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.536221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b6e34-f5da-4acb-bbe1-c9b12cf82949 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.536358 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b6e34-f5da-4acb-bbe1-c9b12cf82949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.556690 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f33b6e34-f5da-4acb-bbe1-c9b12cf82949 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:24.557893 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f33b6e34-f5da-4acb-bbe1-c9b12cf82949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:24.616481 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1416/2807] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:24.624494 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eb636-bf49-4024-9b13-831fa6810397 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.624765 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eb636-bf49-4024-9b13-831fa6810397 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.625046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2eb636-bf49-4024-9b13-831fa6810397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.645182 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-3a2eb636-bf49-4024-9b13-831fa6810397 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:24.646452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-3a2eb636-bf49-4024-9b13-831fa6810397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:24.654621 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1392/2808] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:24.658955 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b6e34-f5da-4acb-bbe1-c9b12cf82949 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:24.669779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b6e34-f5da-4acb-bbe1-c9b12cf82949 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:24.674348 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:24.675569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.675866 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.676177 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.676830 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:25:24.677136 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:24.678735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:24.680228 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:24.691285 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1417/2809] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:25:24.695676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2eb636-bf49-4024-9b13-831fa6810397 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:24.705302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2eb636-bf49-4024-9b13-831fa6810397 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:24.710862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:24.711482 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.711762 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.712088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.712737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:24.714787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:24.786854 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:24.793982 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1393/2810] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:25:24 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:24.798340 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:24.808428 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e95364-34c5-4144-b73c-e1417348dc2e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:24.864211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:24.864817 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.865098 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.865372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.866003 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:24.868295 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:24.940278 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1418/2811] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:25:24 2022] POST /identity/v3/users => generated 278 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:24.945212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:24.955479 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b8be9-4c57-4279-a865-c2d5ca7bce8a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:24.960729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:24.961328 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.961648 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.961936 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.962587 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:24.964213 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:24.976132 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1394/2812] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:24.982977 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:24.990684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ddfda-a864-4e53-ba52-32880abcd8c7 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:24.995544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39ec4-67df-48b4-a883-aa080cb96c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:24.996171 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39ec4-67df-48b4-a883-aa080cb96c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:24.996440 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39ec4-67df-48b4-a883-aa080cb96c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:24.996741 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39ec4-67df-48b4-a883-aa080cb96c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:24.997382 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39ec4-67df-48b4-a883-aa080cb96c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:24.998965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39ec4-67df-48b4-a883-aa080cb96c4d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.010331 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1419/2813] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:25.014397 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:25.026324 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3de8-abfe-42d2-a5bb-2279345e397e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:25.031335 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:25.032001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.032278 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.032546 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] PATH_INFO: `/v3/projects/3d48e1e9367a40498f3607a628e566db/users/dd0c8a2200214c9389177c489a314b29/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.047338 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d48e1e9367a40498f3607a628e566db, user_id=dd0c8a2200214c9389177c489a314b29, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:25.049874 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.145282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1395/2814] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:25:25 2022] PUT /identity/v3/projects/3d48e1e9367a40498f3607a628e566db/users/dd0c8a2200214c9389177c489a314b29/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:25.155844 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ace77-40d9-4fbd-a646-6ef204cbc88f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.156151 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ace77-40d9-4fbd-a646-6ef204cbc88f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.156429 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ace77-40d9-4fbd-a646-6ef204cbc88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.184954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-7a1ace77-40d9-4fbd-a646-6ef204cbc88f None None] MFA Rules not processed for user `dd0c8a2200214c9389177c489a314b29`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:25.186180 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-7a1ace77-40d9-4fbd-a646-6ef204cbc88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:25.251353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1420/2815] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:25.256468 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:25.318418 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bb72a-467e-4478-8b62-0058962f80d9 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:25.323143 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:25.323747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.324061 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.324341 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.324980 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:25.326899 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.434530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1396/2816] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:25:25 2022] POST /identity/v3/projects => generated 355 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:25.438577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ace77-40d9-4fbd-a646-6ef204cbc88f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:25.450326 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ace77-40d9-4fbd-a646-6ef204cbc88f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:25.510806 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:25.511338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.511620 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.511891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.512534 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:25.514453 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.523497 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:25.643109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1421/2817] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:25:25 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:25.647247 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:25.657593 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5dd783-92fe-43b2-a458-60aea38e4562 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:25.662924 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:25.663512 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.663786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.664092 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.664773 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:25.666375 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.677611 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1397/2818] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:25.681851 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:25.692527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930946e-0d32-45a2-859b-a231373a48f4 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:25.697243 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:25.698115 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.698403 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.698681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] PATH_INFO: `/v3/projects/db2ef647895642daa9077e237f128bea/users/9ea5186c15804ad1a4a0e5c7f8882ee9/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.714127 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2ef647895642daa9077e237f128bea, user_id=9ea5186c15804ad1a4a0e5c7f8882ee9, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:25.716992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.802383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1422/2819] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:25:25 2022] PUT /identity/v3/projects/db2ef647895642daa9077e237f128bea/users/9ea5186c15804ad1a4a0e5c7f8882ee9/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:25:25.806417 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:25.816791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24826f-9344-4332-9872-d4f13c3edee8 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:25.872431 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c4994-005b-4571-bf13-c9077cddd778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:25.873029 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c4994-005b-4571-bf13-c9077cddd778 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.873434 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c4994-005b-4571-bf13-c9077cddd778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.873710 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c4994-005b-4571-bf13-c9077cddd778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.874352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c4994-005b-4571-bf13-c9077cddd778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:25.875965 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c4994-005b-4571-bf13-c9077cddd778 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.885680 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1398/2820] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:25.889800 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:25.900810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d316-0f49-4bf5-8e75-d2b479121a66 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:25.905467 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:25.906178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.906459 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.906808 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] PATH_INFO: `/v3/projects/db2ef647895642daa9077e237f128bea/users/9ea5186c15804ad1a4a0e5c7f8882ee9/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.908832 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2ef647895642daa9077e237f128bea, user_id=9ea5186c15804ad1a4a0e5c7f8882ee9, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:25.912392 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:25.922882 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1423/2821] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:25:25 2022] PUT /identity/v3/projects/db2ef647895642daa9077e237f128bea/users/9ea5186c15804ad1a4a0e5c7f8882ee9/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:25.934578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9c2aa-c74e-44d3-bfbc-482a62df6919 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:25.934880 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9c2aa-c74e-44d3-bfbc-482a62df6919 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:25.935153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9c2aa-c74e-44d3-bfbc-482a62df6919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:25.964201 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-abc9c2aa-c74e-44d3-bfbc-482a62df6919 None None] MFA Rules not processed for user `9ea5186c15804ad1a4a0e5c7f8882ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:25.965541 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-abc9c2aa-c74e-44d3-bfbc-482a62df6919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:25.988537 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:26.040343 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1399/2822] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:26.051849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:26.053701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:26.133891 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2bdf-4d3f-4d50-a001-44c1c41c5527 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:26.137568 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:26.138168 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:26.138455 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:26.138716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:26.148277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:26.149704 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:26.158953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1424/2823] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:26.371383 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9c2aa-c74e-44d3-bfbc-482a62df6919 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:26.382190 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9c2aa-c74e-44d3-bfbc-482a62df6919 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:26.386041 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d203d12-42cf-4dcd-9376-132e407a380c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:26.386682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203d12-42cf-4dcd-9376-132e407a380c service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:26.387037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203d12-42cf-4dcd-9376-132e407a380c service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:26.387596 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d203d12-42cf-4dcd-9376-132e407a380c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:26.449590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d203d12-42cf-4dcd-9376-132e407a380c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:26.451031 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d203d12-42cf-4dcd-9376-132e407a380c service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:26.460640 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1400/2824] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:36.154802 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:INSERT=4,keystone:SELECT=52 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:36.455807 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=47 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:45.200328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:45.262496 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7fea-8aa1-4e1d-910a-b69da0621884 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:45.267015 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:45.267631 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:45.267928 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:45.268211 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] PATH_INFO: `/v3/users/dd0c8a2200214c9389177c489a314b29` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:45.269353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0c8a2200214c9389177c489a314b29)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:45.271280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:45.479813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0c8a2200214c9389177c489a314b29'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:45.492019 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0c8a2200214c9389177c489a314b29'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:45.492650 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0c8a2200214c9389177c489a314b29'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:45.589875 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0c8a2200214c9389177c489a314b29'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:45.597336 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0c8a2200214c9389177c489a314b29'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:45.603495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1425/2825] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:25:45 2022] DELETE /identity/v3/users/dd0c8a2200214c9389177c489a314b29 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:25:45.607991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:45.608464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:45.608563 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:45.627357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:45.628578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:45.687097 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1401/2826] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:45.697492 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:45.698906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:45.760536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62a13a-3c17-48ca-87fe-9afba9199d87 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:45.764144 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:45.764749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:45.765024 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:45.765290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:45.774529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:45.775993 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:45.785338 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1426/2827] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:46.187716 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:46.189243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:46.203597 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046627b0-b616-4112-b7bd-256c2afc1ccf None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:46.208957 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:46.209764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:46.210054 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:46.210310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] PATH_INFO: `/v3/projects/3d48e1e9367a40498f3607a628e566db` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:46.211454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d48e1e9367a40498f3607a628e566db)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:46.213549 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:46.334181 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d48e1e9367a40498f3607a628e566db', 'request_id': 'req-029ecc58-4992-41ce-bcb7-ab1baa6cf754'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.339801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d48e1e9367a40498f3607a628e566db', 'request_id': 'req-029ecc58-4992-41ce-bcb7-ab1baa6cf754'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.397118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d48e1e9367a40498f3607a628e566db', 'request_id': 'req-029ecc58-4992-41ce-bcb7-ab1baa6cf754'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.409295 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] The token cache is being invalidate because project 3d48e1e9367a40498f3607a628e566db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:25:46.409585 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.410242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.411745 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1402/2828] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:25:46 2022] DELETE /identity/v3/projects/3d48e1e9367a40498f3607a628e566db => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:46.416556 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:46.426595 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3e832-96f6-42e6-a107-085556a1af93 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:46.445521 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:46.484189 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:46.484819 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:46.485114 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:46.485368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] PATH_INFO: `/v3/users/9ea5186c15804ad1a4a0e5c7f8882ee9` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:46.486525 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea5186c15804ad1a4a0e5c7f8882ee9)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:46.488516 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:46.650668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea5186c15804ad1a4a0e5c7f8882ee9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.662264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea5186c15804ad1a4a0e5c7f8882ee9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.662926 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea5186c15804ad1a4a0e5c7f8882ee9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.740439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea5186c15804ad1a4a0e5c7f8882ee9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.748511 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-81881977-f3b0-450f-8581-756c99bf7952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea5186c15804ad1a4a0e5c7f8882ee9'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:46.754396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1427/2829] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:25:46 2022] DELETE /identity/v3/users/9ea5186c15804ad1a4a0e5c7f8882ee9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:47.141256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:47.142721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:47.157530 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ecc58-4992-41ce-bcb7-ab1baa6cf754 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:47.213083 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:47.213634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.213907 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.214173 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] PATH_INFO: `/v3/projects/db2ef647895642daa9077e237f128bea` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.215274 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2ef647895642daa9077e237f128bea)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:47.217220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:47.293795 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:47.309272 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2ef647895642daa9077e237f128bea', 'request_id': 'req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:47.314433 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2ef647895642daa9077e237f128bea', 'request_id': 'req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:47.384220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2ef647895642daa9077e237f128bea', 'request_id': 'req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:47.395855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] The token cache is being invalidate because project db2ef647895642daa9077e237f128bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:25:47.396192 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:47.396823 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-8eb7b49d-2d07-47ea-b32e-f5ec4e32beeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:47.398443 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1403/2830] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:25:47 2022] DELETE /identity/v3/projects/db2ef647895642daa9077e237f128bea => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:47.403396 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9141-bf0b-4dd3-8097-224bfe9e0d01 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.403683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9141-bf0b-4dd3-8097-224bfe9e0d01 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.403995 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e9141-bf0b-4dd3-8097-224bfe9e0d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.423642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b85e9141-bf0b-4dd3-8097-224bfe9e0d01 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:47.424930 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b85e9141-bf0b-4dd3-8097-224bfe9e0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:47.484611 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1428/2831] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:47.493490 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1795e-da1e-4723-87ce-f7a92977c9cc None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.493766 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1795e-da1e-4723-87ce-f7a92977c9cc None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.494039 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1795e-da1e-4723-87ce-f7a92977c9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.513785 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-49c1795e-da1e-4723-87ce-f7a92977c9cc None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:47.514976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-49c1795e-da1e-4723-87ce-f7a92977c9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:47.522800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1404/2832] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:47.527166 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9141-bf0b-4dd3-8097-224bfe9e0d01 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:47.536937 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e9141-bf0b-4dd3-8097-224bfe9e0d01 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:47.543599 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:47.544248 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.544524 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.544793 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.545436 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:25:47.545737 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:47.547368 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:47.559586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1429/2833] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 05:25:47.563926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1795e-da1e-4723-87ce-f7a92977c9cc None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:47.573764 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1795e-da1e-4723-87ce-f7a92977c9cc None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:47.578564 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:47.579157 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.579430 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.579696 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.580346 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:47.582333 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:47.657637 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1405/2834] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:25:47 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:47.662125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:47.673309 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331282b9-6bb1-46ee-a8a0-5ee3be0e30eb admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:47.707948 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:47.738684 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:47.739291 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.739570 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.739843 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.740513 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:47.743627 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:47.820056 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1430/2835] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:25:47 2022] POST /identity/v3/users => generated 282 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:25:47.824189 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:47.834734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab8377-0e80-484b-8cc8-667120144089 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:47.839406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:47.840032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.840304 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.840571 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.841208 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:47.842800 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:47.852991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1406/2836] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:47.856803 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:47.867535 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761b29-3e8c-461a-a1d3-ee47229e1401 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:47.872394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77cea0-e309-42cf-9d4f-df5d0e34dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:47.873004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cea0-e309-42cf-9d4f-df5d0e34dd7a admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.873279 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cea0-e309-42cf-9d4f-df5d0e34dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.873550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77cea0-e309-42cf-9d4f-df5d0e34dd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.874184 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77cea0-e309-42cf-9d4f-df5d0e34dd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:47.875769 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77cea0-e309-42cf-9d4f-df5d0e34dd7a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:47.885747 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1431/2837] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:47.889657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:47.899463 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a8634-b78e-45ae-9291-4a580fb1b7f5 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:47.904048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:47.904676 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:47.904953 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:47.905220 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] PATH_INFO: `/v3/projects/507a3f25fd074bf093133626e812bf7d/users/c0cbe66824b34a6bbc5729d2137548ff/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:47.920028 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=507a3f25fd074bf093133626e812bf7d, user_id=c0cbe66824b34a6bbc5729d2137548ff, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:47.922729 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.049679 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1407/2838] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:25:47 2022] PUT /identity/v3/projects/507a3f25fd074bf093133626e812bf7d/users/c0cbe66824b34a6bbc5729d2137548ff/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:48.061270 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276e14b-9fc5-474d-bbe6-7a3064d2667d None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.064898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276e14b-9fc5-474d-bbe6-7a3064d2667d None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.064898 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276e14b-9fc5-474d-bbe6-7a3064d2667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.094987 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-2276e14b-9fc5-474d-bbe6-7a3064d2667d None None] MFA Rules not processed for user `c0cbe66824b34a6bbc5729d2137548ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:48.096255 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2276e14b-9fc5-474d-bbe6-7a3064d2667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:48.159786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1432/2839] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:48.164894 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:48.225449 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b1047-8fe7-44f7-a9ca-1124cf5992bb admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:48.230740 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:48.231337 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.231612 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.231882 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.232535 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:48.234438 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.300666 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1408/2840] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:25:48 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:48.309178 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276e14b-9fc5-474d-bbe6-7a3064d2667d None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:48.321931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276e14b-9fc5-474d-bbe6-7a3064d2667d None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:48.377408 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:48.378013 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.378290 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.378560 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.379182 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:48.381167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.471347 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1433/2841] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:25:48 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:25:48.475461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:48.486248 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9ff94-1017-44c1-b77e-45b1bb365512 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:48.491046 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:48.491801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.492118 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.492450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.493374 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:48.494977 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.505465 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1409/2842] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:25:48.510319 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:48.520349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba0266-fea3-489b-b254-78689f1634d2 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:48.525745 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:48.526389 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.526663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.526936 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] PATH_INFO: `/v3/projects/691b425c6eaf4c0cb23b76e43930426e/users/24f9df6ebda64f12ac25256bf879aa22/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.541394 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691b425c6eaf4c0cb23b76e43930426e, user_id=24f9df6ebda64f12ac25256bf879aa22, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:48.544086 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.614321 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1434/2843] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:25:48 2022] PUT /identity/v3/projects/691b425c6eaf4c0cb23b76e43930426e/users/24f9df6ebda64f12ac25256bf879aa22/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:48.618921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:48.630791 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af287da0-ade5-4a95-abbe-779405325fba admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:48.651962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:48.690037 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb47131-90ea-47da-bd2e-4f7604d20c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:48.690649 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb47131-90ea-47da-bd2e-4f7604d20c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.690952 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb47131-90ea-47da-bd2e-4f7604d20c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.691273 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb47131-90ea-47da-bd2e-4f7604d20c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.692127 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb47131-90ea-47da-bd2e-4f7604d20c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:48.693726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb47131-90ea-47da-bd2e-4f7604d20c4e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.704930 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1410/2844] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:25:48.709004 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:48.716931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:48.720664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c1a32-c05a-4108-b135-b331c2e2cf68 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:48.725821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:48.726582 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.726863 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.727282 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] PATH_INFO: `/v3/projects/691b425c6eaf4c0cb23b76e43930426e/users/24f9df6ebda64f12ac25256bf879aa22/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.729257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=691b425c6eaf4c0cb23b76e43930426e, user_id=24f9df6ebda64f12ac25256bf879aa22, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:48.732002 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.743183 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1435/2845] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:25:48 2022] PUT /identity/v3/projects/691b425c6eaf4c0cb23b76e43930426e/users/24f9df6ebda64f12ac25256bf879aa22/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:48.753450 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd71e-40c4-4937-8b4b-952162815c5a None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.753734 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd71e-40c4-4937-8b4b-952162815c5a None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.754010 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bd71e-40c4-4937-8b4b-952162815c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.781717 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-647bd71e-40c4-4937-8b4b-952162815c5a None None] MFA Rules not processed for user `24f9df6ebda64f12ac25256bf879aa22`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:48.782926 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-647bd71e-40c4-4937-8b4b-952162815c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:48.849701 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1411/2846] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:48.861273 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:48.863042 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:48.921777 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380b85e-b8d7-414c-97a1-dd57d0dddf1f admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:48.925383 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:48.925981 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:48.926257 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:48.926527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:48.936259 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:48.937687 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:48.947821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1436/2847] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:49.237962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd71e-40c4-4937-8b4b-952162815c5a None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:49.249017 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bd71e-40c4-4937-8b4b-952162815c5a None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:49.252786 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b8f7b-b5cd-4897-91e0-d6fe1d2707b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:49.256369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b8f7b-b5cd-4897-91e0-d6fe1d2707b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:49.256369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b8f7b-b5cd-4897-91e0-d6fe1d2707b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:49.256369 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b8f7b-b5cd-4897-91e0-d6fe1d2707b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:49.311498 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b8f7b-b5cd-4897-91e0-d6fe1d2707b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:49.313131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b8f7b-b5cd-4897-91e0-d6fe1d2707b7 service cinder] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:49.322371 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1412/2848] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:58.160692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:58.222956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5080af2-3414-46c0-8f90-d4dc8d2decfc service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:58.227953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:58.228614 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:58.228894 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:58.229163 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] PATH_INFO: `/v3/users/c0cbe66824b34a6bbc5729d2137548ff` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:58.230264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cbe66824b34a6bbc5729d2137548ff)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:58.232213 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:58.421782 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cbe66824b34a6bbc5729d2137548ff'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:58.433550 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cbe66824b34a6bbc5729d2137548ff'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:58.434212 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cbe66824b34a6bbc5729d2137548ff'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:58.505079 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cbe66824b34a6bbc5729d2137548ff'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:58.512137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cbe66824b34a6bbc5729d2137548ff'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:58.518133 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1437/2849] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:25:58 2022] DELETE /identity/v3/users/c0cbe66824b34a6bbc5729d2137548ff => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:58.522738 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:58.526205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:58.526205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:58.542925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:25:58.544150 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:58.581881 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=100 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:58.600141 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1413/2850] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:25:58.610530 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:58.612084 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:58.625961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:58.669912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83f687-2b9e-49c3-8b29-413497025af8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:58.673551 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:58.674146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:58.674421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:58.674688 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:58.683855 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:58.685328 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:58.694913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1438/2851] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:25:59.073064 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:59.074630 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:25:59.087540 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d773f-f182-47ef-8548-11dff40a0611 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:59.092683 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:59.093331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:59.093613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:59.093889 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] PATH_INFO: `/v3/projects/507a3f25fd074bf093133626e812bf7d` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:59.095320 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507a3f25fd074bf093133626e812bf7d)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:59.097354 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:59.213641 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507a3f25fd074bf093133626e812bf7d', 'request_id': 'req-23e1ce5c-e3be-4ed0-a062-0f517947ef43'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.219055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507a3f25fd074bf093133626e812bf7d', 'request_id': 'req-23e1ce5c-e3be-4ed0-a062-0f517947ef43'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.323159 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507a3f25fd074bf093133626e812bf7d', 'request_id': 'req-23e1ce5c-e3be-4ed0-a062-0f517947ef43'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.335194 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] The token cache is being invalidate because project 507a3f25fd074bf093133626e812bf7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:25:59.335484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.336147 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.337968 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1414/2852] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:25:59 2022] DELETE /identity/v3/projects/507a3f25fd074bf093133626e812bf7d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:25:59.342143 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:25:59.352301 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c753-efc0-4c4d-8e62-3b87110649f0 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:25:59.408502 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:25:59.409125 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:25:59.409401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:25:59.409668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] PATH_INFO: `/v3/users/24f9df6ebda64f12ac25256bf879aa22` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:25:59.410763 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f9df6ebda64f12ac25256bf879aa22)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:25:59.412826 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:25:59.628588 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f9df6ebda64f12ac25256bf879aa22'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.642899 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f9df6ebda64f12ac25256bf879aa22'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.643579 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f9df6ebda64f12ac25256bf879aa22'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.739733 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f9df6ebda64f12ac25256bf879aa22'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.748055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3df02842-7c9b-4aa5-88d1-41a9b8ace607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f9df6ebda64f12ac25256bf879aa22'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:25:59.754028 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1439/2853] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:25:59 2022] DELETE /identity/v3/users/24f9df6ebda64f12ac25256bf879aa22 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:00.147301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:00.149613 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:00.162368 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1ce5c-e3be-4ed0-a062-0f517947ef43 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:00.220139 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:00.220772 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.221050 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.221321 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] PATH_INFO: `/v3/projects/691b425c6eaf4c0cb23b76e43930426e` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.222441 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] RBAC: Authorizing `identity:delete_project(project_id=691b425c6eaf4c0cb23b76e43930426e)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:00.224399 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:00.356921 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691b425c6eaf4c0cb23b76e43930426e', 'request_id': 'req-e50df788-9f6c-4810-8190-01718d9d166f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:00.362282 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691b425c6eaf4c0cb23b76e43930426e', 'request_id': 'req-e50df788-9f6c-4810-8190-01718d9d166f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:00.425624 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691b425c6eaf4c0cb23b76e43930426e', 'request_id': 'req-e50df788-9f6c-4810-8190-01718d9d166f'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:00.433359 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:00.437915 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] The token cache is being invalidate because project 691b425c6eaf4c0cb23b76e43930426e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81749) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:26:00.438310 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:00.438947 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-e50df788-9f6c-4810-8190-01718d9d166f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:00.440528 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1415/2854] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:26:00 2022] DELETE /identity/v3/projects/691b425c6eaf4c0cb23b76e43930426e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:00.446104 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204da1-6966-4d68-88ab-6d50f5f934ce None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.446564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204da1-6966-4d68-88ab-6d50f5f934ce None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.451349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204da1-6966-4d68-88ab-6d50f5f934ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.466386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-25204da1-6966-4d68-88ab-6d50f5f934ce None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:00.467591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-25204da1-6966-4d68-88ab-6d50f5f934ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:00.497495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:00.527865 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1440/2855] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:00.535788 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df257933-20d2-4e5a-b5a7-65653f49eda2 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.536102 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df257933-20d2-4e5a-b5a7-65653f49eda2 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.536378 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df257933-20d2-4e5a-b5a7-65653f49eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.556440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-df257933-20d2-4e5a-b5a7-65653f49eda2 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:00.557665 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-df257933-20d2-4e5a-b5a7-65653f49eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:00.565727 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1416/2856] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 05:26:00.570137 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204da1-6966-4d68-88ab-6d50f5f934ce None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:00.580558 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204da1-6966-4d68-88ab-6d50f5f934ce None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:00.585129 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:00.585723 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.586001 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.586931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.587652 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81750) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:26:00.588090 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:00.589700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:00.601644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1441/2857] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:26:00.605973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df257933-20d2-4e5a-b5a7-65653f49eda2 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:00.615226 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df257933-20d2-4e5a-b5a7-65653f49eda2 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:00.620454 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:00.621040 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.621315 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.621584 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.622205 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:00.624376 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:00.713395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1417/2858] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:26:00 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:26:00.717717 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:00.727615 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9997ac-529c-4d78-a28d-8640f7d509e8 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:00.783692 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:00.784323 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.784605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.784880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.785500 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:00.787423 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:00.934007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1442/2859] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:26:00 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:26:00.938221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:00.948890 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fdfed-451b-48f1-9a15-90a09844a04a admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:00.953499 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:00.954106 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.954385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.954659 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.955301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:00.957048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:00.967920 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1418/2860] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:26:00.971610 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:00.982544 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373c930-86e0-46e4-8d2b-30481fd58f4a admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:00.987198 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334e59b-c3a2-4cdd-8bf7-fad666d04281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:00.987784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334e59b-c3a2-4cdd-8bf7-fad666d04281 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:00.988096 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334e59b-c3a2-4cdd-8bf7-fad666d04281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:00.988369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334e59b-c3a2-4cdd-8bf7-fad666d04281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:00.989008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334e59b-c3a2-4cdd-8bf7-fad666d04281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:00.990600 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334e59b-c3a2-4cdd-8bf7-fad666d04281 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.001462 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1443/2861] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:26:01.005491 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:01.015933 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98ae5-cad3-4447-ab3b-e60e81b10b8d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:01.020534 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:01.021195 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.021480 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.021758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] PATH_INFO: `/v3/projects/23a034d45a834564a1f9238754dad996/users/a54b86fa322a4ba891de6307d6969cb2/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.036737 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a034d45a834564a1f9238754dad996, user_id=a54b86fa322a4ba891de6307d6969cb2, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:01.039654 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.129748 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1419/2862] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:26:01 2022] PUT /identity/v3/projects/23a034d45a834564a1f9238754dad996/users/a54b86fa322a4ba891de6307d6969cb2/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:01.195018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87920637-69ac-427d-83fb-931e00dc2d0f None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.195304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87920637-69ac-427d-83fb-931e00dc2d0f None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.196170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87920637-69ac-427d-83fb-931e00dc2d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.225337 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-87920637-69ac-427d-83fb-931e00dc2d0f None None] MFA Rules not processed for user `a54b86fa322a4ba891de6307d6969cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:01.226495 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-87920637-69ac-427d-83fb-931e00dc2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:01.291417 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1444/2863] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:01.295767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:01.357862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f727f-c365-4e15-b620-170aa67fa259 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:01.362577 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:01.366873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.366873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.366873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] PATH_INFO: `/v3/projects` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.366873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:01.366873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.471608 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1420/2864] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:26:01 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:26:01.476870 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87920637-69ac-427d-83fb-931e00dc2d0f None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:01.490823 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87920637-69ac-427d-83fb-931e00dc2d0f None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:01.519509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:01.548759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:01.549362 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.549642 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.549914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] PATH_INFO: `/v3/users` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.550529 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:01.552482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.625117 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1445/2865] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:26:01 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:26:01.629138 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:01.640253 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8faaa-8763-4626-8524-7d4a86c3f353 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:01.644896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:01.645489 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.645767 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.646038 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.646681 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:01.648322 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.660802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1421/2866] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:26:01.664811 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:01.674637 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed9a0a-4b5f-4a7f-a53c-ef727425e881 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:01.679170 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:01.679805 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.680641 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.680914 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] PATH_INFO: `/v3/projects/0cb03560f62c48ac87f7853d8ea4d366/users/228c12ee467f466aacb4cb8948819491/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.695509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb03560f62c48ac87f7853d8ea4d366, user_id=228c12ee467f466aacb4cb8948819491, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:01.698764 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.774912 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1446/2867] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:26:01 2022] PUT /identity/v3/projects/0cb03560f62c48ac87f7853d8ea4d366/users/228c12ee467f466aacb4cb8948819491/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:26:01.778906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:01.788825 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e8cdd-eb95-4fff-a584-1917312ef64f admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:01.844210 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cac75e-4580-4fd5-8f46-33240db6ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:01.844815 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cac75e-4580-4fd5-8f46-33240db6ce2f admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.845088 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cac75e-4580-4fd5-8f46-33240db6ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.845357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cac75e-4580-4fd5-8f46-33240db6ce2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.845987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cac75e-4580-4fd5-8f46-33240db6ce2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:01.847581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cac75e-4580-4fd5-8f46-33240db6ce2f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.858004 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1422/2868] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:26:01.862154 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:01.873849 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c8176-f106-4a35-ab14-429c252b0166 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:01.878549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:01.879199 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.879482 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.879759 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] PATH_INFO: `/v3/projects/0cb03560f62c48ac87f7853d8ea4d366/users/228c12ee467f466aacb4cb8948819491/roles/4e7c4376e62c42fca4caecc9b36193ee` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.881716 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb03560f62c48ac87f7853d8ea4d366, user_id=228c12ee467f466aacb4cb8948819491, role_id=4e7c4376e62c42fca4caecc9b36193ee)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:01.884969 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:01.894985 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1447/2869] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:26:01 2022] PUT /identity/v3/projects/0cb03560f62c48ac87f7853d8ea4d366/users/228c12ee467f466aacb4cb8948819491/roles/4e7c4376e62c42fca4caecc9b36193ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:26:01.905352 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be89a7-ac1f-4ccf-8d70-74769ad98759 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:01.905638 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be89a7-ac1f-4ccf-8d70-74769ad98759 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:01.905911 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be89a7-ac1f-4ccf-8d70-74769ad98759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:01.914022 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:01.934733 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-19be89a7-ac1f-4ccf-8d70-74769ad98759 None None] MFA Rules not processed for user `228c12ee467f466aacb4cb8948819491`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:01.935985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-19be89a7-ac1f-4ccf-8d70-74769ad98759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:02.003845 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1423/2870] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:02.015557 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:02.017287 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:02.078508 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd771cc-e52d-4962-a9cd-55aa93e2d3c3 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:02.083569 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ad5a3-0e60-406b-9100-3f91e2bc1e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:02.084221 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ad5a3-0e60-406b-9100-3f91e2bc1e46 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:02.084505 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ad5a3-0e60-406b-9100-3f91e2bc1e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:02.084779 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ad5a3-0e60-406b-9100-3f91e2bc1e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:02.098536 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ad5a3-0e60-406b-9100-3f91e2bc1e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:02.100879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ad5a3-0e60-406b-9100-3f91e2bc1e46 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:02.110931 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1448/2871] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:05.364125 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be89a7-ac1f-4ccf-8d70-74769ad98759 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:05.427048 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be89a7-ac1f-4ccf-8d70-74769ad98759 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:05.432005 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:05.432595 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:05.432878 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:05.433153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] PATH_INFO: `/v3/users/a54b86fa322a4ba891de6307d6969cb2` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:05.434288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54b86fa322a4ba891de6307d6969cb2)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:05.436288 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:05.716230 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54b86fa322a4ba891de6307d6969cb2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:05.716883 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54b86fa322a4ba891de6307d6969cb2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:05.717486 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54b86fa322a4ba891de6307d6969cb2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:05.774407 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54b86fa322a4ba891de6307d6969cb2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:05.781427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54b86fa322a4ba891de6307d6969cb2'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:05.799170 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1424/2872] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:26:05 2022] DELETE /identity/v3/users/a54b86fa322a4ba891de6307d6969cb2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:05.803532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:05.804011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:05.804109 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:05.823069 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:05.824315 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:05.882200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1449/2873] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:05.892461 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:05.893841 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:05.904964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:05.951531 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f38bc-6f88-4033-80b8-32396ef4ae2e admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:05.955096 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:05.955688 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:05.955999 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:05.956276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:05.965303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:05.966833 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:05.977351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1425/2874] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:06.403422 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:06.404954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:06.417725 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b4f33-97f3-4d27-96fd-53101ea12682 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:06.422555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:06.423190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:06.423468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:06.423738 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] PATH_INFO: `/v3/projects/23a034d45a834564a1f9238754dad996` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:06.424971 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a034d45a834564a1f9238754dad996)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:06.426883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:06.449700 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:06.562471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a034d45a834564a1f9238754dad996', 'request_id': 'req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.568794 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a034d45a834564a1f9238754dad996', 'request_id': 'req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.646397 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a034d45a834564a1f9238754dad996', 'request_id': 'req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.657711 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] The token cache is being invalidate because project 23a034d45a834564a1f9238754dad996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:26:06.658040 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.658664 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.660313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1450/2875] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:26:06 2022] DELETE /identity/v3/projects/23a034d45a834564a1f9238754dad996 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:06.664419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:06.675355 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b721a8-7981-453b-af65-8ce51049c9f3 service neutron] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:06.734065 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:06.734704 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:06.734985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:06.735262 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] PATH_INFO: `/v3/users/228c12ee467f466aacb4cb8948819491` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:06.736422 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228c12ee467f466aacb4cb8948819491)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:06.738362 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:06.916646 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228c12ee467f466aacb4cb8948819491'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.917215 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228c12ee467f466aacb4cb8948819491'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.917843 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228c12ee467f466aacb4cb8948819491'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.985256 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228c12ee467f466aacb4cb8948819491'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:06.992565 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-c22d20b5-c153-429b-b712-7dc602df61f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228c12ee467f466aacb4cb8948819491'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:07.010212 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1426/2876] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:26:06 2022] DELETE /identity/v3/users/228c12ee467f466aacb4cb8948819491 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:07.432986 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:07.434471 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:07.449708 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2fc7-e7b5-4193-ad7c-5620e627d289 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:07.508607 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:07.509230 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:07.509509 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:07.509780 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] PATH_INFO: `/v3/projects/0cb03560f62c48ac87f7853d8ea4d366` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:07.510883 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb03560f62c48ac87f7853d8ea4d366)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:07.512828 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:07.625689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb03560f62c48ac87f7853d8ea4d366', 'request_id': 'req-332484ce-1987-4d14-b5ce-d6e9fc13fe16'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:07.631778 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb03560f62c48ac87f7853d8ea4d366', 'request_id': 'req-332484ce-1987-4d14-b5ce-d6e9fc13fe16'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:07.709619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb03560f62c48ac87f7853d8ea4d366', 'request_id': 'req-332484ce-1987-4d14-b5ce-d6e9fc13fe16'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:07.721099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] The token cache is being invalidate because project 0cb03560f62c48ac87f7853d8ea4d366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:26:07.721386 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:07.725068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-332484ce-1987-4d14-b5ce-d6e9fc13fe16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:07.725068 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1451/2877] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:26:07 2022] DELETE /identity/v3/projects/0cb03560f62c48ac87f7853d8ea4d366 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:07.729758 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc1685-d03d-4d19-9521-34dc2571c7fa None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:07.730239 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc1685-d03d-4d19-9521-34dc2571c7fa None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:07.730349 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc1685-d03d-4d19-9521-34dc2571c7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:07.750204 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-bafc1685-d03d-4d19-9521-34dc2571c7fa None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:07.751400 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-bafc1685-d03d-4d19-9521-34dc2571c7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:07.776910 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:07.809816 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1427/2878] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:07.819007 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518857e-0615-456a-85a9-e82e3b96ba24 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:07.819294 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518857e-0615-456a-85a9-e82e3b96ba24 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:07.819575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518857e-0615-456a-85a9-e82e3b96ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:07.839372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-b518857e-0615-456a-85a9-e82e3b96ba24 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:07.840644 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-b518857e-0615-456a-85a9-e82e3b96ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:07.848906 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1452/2879] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:07.853892 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc1685-d03d-4d19-9521-34dc2571c7fa None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:07.863755 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc1685-d03d-4d19-9521-34dc2571c7fa None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:07.869019 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:07.869673 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:07.869961 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:07.870457 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:07.871164 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:26:07.871684 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:07.874227 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:07.886187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1428/2880] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:26:07.890667 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518857e-0615-456a-85a9-e82e3b96ba24 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:07.900575 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518857e-0615-456a-85a9-e82e3b96ba24 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:07.905277 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:07.905868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:07.906148 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:07.906421 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:07.907055 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:07.909031 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:08.031739 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1453/2881] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:26:07 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 05:26:08.040331 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:08.046151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea6edf-51e1-4738-9727-95bd1c86daf4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:08.100732 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:08.101330 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:08.101603 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:08.101873 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:08.102747 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:08.104736 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:08.208503 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1429/2882] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:26:08 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:26:08.212965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:08.223749 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e234e2-dde0-45ee-87e9-6808bd60ff1d admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:08.228555 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:08.229152 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:08.229432 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:08.229705 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:08.230344 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:08.231979 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:08.234305 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:08.242564 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1454/2883] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:26:08.247401 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:08.258055 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327386df-c2ed-41a3-ad68-c1a49ee2912f admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:08.263797 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c579809-076e-4a50-a975-1663b9ffcc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:08.264429 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579809-076e-4a50-a975-1663b9ffcc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:08.264707 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579809-076e-4a50-a975-1663b9ffcc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:08.264976 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c579809-076e-4a50-a975-1663b9ffcc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:08.265617 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579809-076e-4a50-a975-1663b9ffcc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:08.267229 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c579809-076e-4a50-a975-1663b9ffcc13 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:08.278351 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1430/2884] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:26:08.282469 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:08.292468 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5c6e9-3d63-4337-9344-3bc77e2d2167 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:08.297494 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:08.298145 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:08.298425 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:08.298701 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] PATH_INFO: `/v3/projects/4a0a1a1397c1499e8b2e123eda8ab417/users/879256b119d9428da59563c37fe0e5e7/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:08.314011 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a0a1a1397c1499e8b2e123eda8ab417, user_id=879256b119d9428da59563c37fe0e5e7, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:08.317577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:08.377959 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1455/2885] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:26:08 2022] PUT /identity/v3/projects/4a0a1a1397c1499e8b2e123eda8ab417/users/879256b119d9428da59563c37fe0e5e7/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 05:26:08.389393 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afc77-cde5-494c-a91c-d51c0c5bf91f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:08.389682 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afc77-cde5-494c-a91c-d51c0c5bf91f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:08.390018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afc77-cde5-494c-a91c-d51c0c5bf91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:08.417578 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-ef5afc77-cde5-494c-a91c-d51c0c5bf91f None None] MFA Rules not processed for user `879256b119d9428da59563c37fe0e5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:08.419385 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ef5afc77-cde5-494c-a91c-d51c0c5bf91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:08.482988 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1431/2886] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:08.494538 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:08.496322 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:08.554008 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec90df9-2ec4-480d-a8ee-13bed62b3a04 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:08.558253 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e0c19-339f-41fc-8e26-cb20d351343d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:08.558913 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0c19-339f-41fc-8e26-cb20d351343d service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:08.559190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0c19-339f-41fc-8e26-cb20d351343d service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:08.559460 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e0c19-339f-41fc-8e26-cb20d351343d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:08.567729 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0c19-339f-41fc-8e26-cb20d351343d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:08.569188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e0c19-339f-41fc-8e26-cb20d351343d service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:08.578081 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1456/2887] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:26:12.730906 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5afc77-cde5-494c-a91c-d51c0c5bf91f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:12.761610 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:12.793495 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5afc77-cde5-494c-a91c-d51c0c5bf91f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:12.798131 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:12.802066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:12.802066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:12.802066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] PATH_INFO: `/v3/users/879256b119d9428da59563c37fe0e5e7` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:12.802066 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879256b119d9428da59563c37fe0e5e7)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:12.802442 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:12.959268 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879256b119d9428da59563c37fe0e5e7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:12.959849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879256b119d9428da59563c37fe0e5e7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:12.960520 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879256b119d9428da59563c37fe0e5e7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.024787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879256b119d9428da59563c37fe0e5e7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.031962 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879256b119d9428da59563c37fe0e5e7'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.049556 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1432/2888] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:26:12 2022] DELETE /identity/v3/users/879256b119d9428da59563c37fe0e5e7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:13.054207 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:13.054668 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:13.054786 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:13.073999 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:13.075217 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:13.132349 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1457/2889] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:13.142360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:13.151221 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:13.206513 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1582da-bc20-4a42-b2f7-d90865cb5620 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:13.210187 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e93114-cf60-44b1-a389-8e0a2c9965f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:13.210726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93114-cf60-44b1-a389-8e0a2c9965f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:13.211001 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93114-cf60-44b1-a389-8e0a2c9965f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:13.211276 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93114-cf60-44b1-a389-8e0a2c9965f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:13.220398 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e93114-cf60-44b1-a389-8e0a2c9965f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:13.221849 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e93114-cf60-44b1-a389-8e0a2c9965f5 service neutron] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:13.232030 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1433/2890] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:13.644514 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:13.645940 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:13.658956 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f41b3-d6b2-45bb-936d-7ef81a932bf3 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:13.663888 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:13.664604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:13.669549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:13.669549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] PATH_INFO: `/v3/projects/4a0a1a1397c1499e8b2e123eda8ab417` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:13.669549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a0a1a1397c1499e8b2e123eda8ab417)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:13.670354 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:13.866275 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0a1a1397c1499e8b2e123eda8ab417', 'request_id': 'req-236eb6c2-7923-47c5-b079-7ce748aa44df'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.873038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0a1a1397c1499e8b2e123eda8ab417', 'request_id': 'req-236eb6c2-7923-47c5-b079-7ce748aa44df'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.945181 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0a1a1397c1499e8b2e123eda8ab417', 'request_id': 'req-236eb6c2-7923-47c5-b079-7ce748aa44df'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.953038 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:13.956734 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] The token cache is being invalidate because project 4a0a1a1397c1499e8b2e123eda8ab417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:26:13.957020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.957639 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-236eb6c2-7923-47c5-b079-7ce748aa44df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:26:13.959112 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1458/2891] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:26:13 2022] DELETE /identity/v3/projects/4a0a1a1397c1499e8b2e123eda8ab417 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:13.964634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3621-fe42-464f-ba6e-ac6245e6a83f None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:13.965142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3621-fe42-464f-ba6e-ac6245e6a83f None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:13.965245 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c3621-fe42-464f-ba6e-ac6245e6a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:13.984590 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-008c3621-fe42-464f-ba6e-ac6245e6a83f None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:13.985794 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-008c3621-fe42-464f-ba6e-ac6245e6a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:14.029416 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:14.044250 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1434/2892] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:14.052167 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c8a5-ac5a-4cc2-926c-e9cf524138f0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.052451 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c8a5-ac5a-4cc2-926c-e9cf524138f0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.052724 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7c8a5-ac5a-4cc2-926c-e9cf524138f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.073057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-39f7c8a5-ac5a-4cc2-926c-e9cf524138f0 None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:14.074252 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-39f7c8a5-ac5a-4cc2-926c-e9cf524138f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:14.082280 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1459/2893] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:14.086370 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c3621-fe42-464f-ba6e-ac6245e6a83f None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:14.097193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c3621-fe42-464f-ba6e-ac6245e6a83f None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:14.101855 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:14.102447 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.102721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.103142 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.103824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81749) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 05:26:14.104151 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:14.105801 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:14.116991 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1435/2894] 10.222.0.45 () {58 vars in 1153 bytes} [Thu Aug 25 05:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 05:26:14.122043 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c8a5-ac5a-4cc2-926c-e9cf524138f0 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:14.131264 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7c8a5-ac5a-4cc2-926c-e9cf524138f0 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:14.136821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:14.137414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.137689 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.137965 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.138604 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:14.140603 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:14.250682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1460/2895] 10.222.0.45 () {60 vars in 1153 bytes} [Thu Aug 25 05:26:14 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:26:14.254511 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:14.265985 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db4976-49bf-45d3-a229-3f70b4cc5ac4 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:14.321484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:14.322007 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.322303 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.323233 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] PATH_INFO: `/v3/users` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.323859 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:14.325787 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:14.413824 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1436/2896] 10.222.0.45 () {60 vars in 1144 bytes} [Thu Aug 25 05:26:14 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 05:26:14.418401 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:14.428846 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a4b3f-0a42-4c7d-bf7a-0d4e0443dc9e admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:14.434416 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:14.435190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.435512 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.435784 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.436464 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:14.438186 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:14.449591 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1461/2897] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 05:26:14.453446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:14.463754 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffe90a-cc86-4a83-94b2-f8f8ec037e7d admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:14.468544 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec3c6d-c9ac-4958-b058-104d66d90d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:14.469162 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3c6d-c9ac-4958-b058-104d66d90d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.469464 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3c6d-c9ac-4958-b058-104d66d90d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.469987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec3c6d-c9ac-4958-b058-104d66d90d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.470634 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3c6d-c9ac-4958-b058-104d66d90d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:14.472566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec3c6d-c9ac-4958-b058-104d66d90d9c admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:14.484246 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1437/2898] 10.222.0.45 () {58 vars in 1122 bytes} [Thu Aug 25 05:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 05:26:14.488369 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:14.499286 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0745d-8194-4970-9d45-a5daafb775f3 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:14.503881 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:14.504546 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.504825 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.505099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] PATH_INFO: `/v3/projects/cf0283392ca34e1bb0a40d097dbd0118/users/8adef8e6dd904084add1b8ac6bb7e66d/roles/e305aaac48e64ec7ae700613e1672700` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.519624 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0283392ca34e1bb0a40d097dbd0118, user_id=8adef8e6dd904084add1b8ac6bb7e66d, role_id=e305aaac48e64ec7ae700613e1672700)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:14.522331 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:14.606837 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1462/2899] 10.222.0.45 () {60 vars in 1483 bytes} [Thu Aug 25 05:26:14 2022] PUT /identity/v3/projects/cf0283392ca34e1bb0a40d097dbd0118/users/8adef8e6dd904084add1b8ac6bb7e66d/roles/e305aaac48e64ec7ae700613e1672700 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:26:14.612124 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dabc4-bef1-4001-a24d-0c1b1907227c None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.612406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dabc4-bef1-4001-a24d-0c1b1907227c None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.612678 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dabc4-bef1-4001-a24d-0c1b1907227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.632759 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-345dabc4-bef1-4001-a24d-0c1b1907227c None None] MFA Rules not processed for user `dde84621695a4b64985c2f72dbefe3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:14.634000 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-345dabc4-bef1-4001-a24d-0c1b1907227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:14.691419 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1438/2900] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:14.701272 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:14.703052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:14.759868 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587fdd4-8cb3-485e-8990-0482e9a76c07 admin admin] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:14.763566 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:14.764188 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:14.764465 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:14.764735 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:14.773532 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:14.774953 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:14.784330 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1463/2901] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 05:26:16.215196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff5ff-f3f1-4117-a37f-3e9be431ff0d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:16.215196 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff5ff-f3f1-4117-a37f-3e9be431ff0d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:16.215657 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff5ff-f3f1-4117-a37f-3e9be431ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:16.246813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-396ff5ff-f3f1-4117-a37f-3e9be431ff0d None None] MFA Rules not processed for user `8adef8e6dd904084add1b8ac6bb7e66d`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:16.248103 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-396ff5ff-f3f1-4117-a37f-3e9be431ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:16.293932 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:16.315415 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1439/2902] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:16.325915 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:16.327313 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:16.385204 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d99a57-6e01-47ed-860d-f9912ba03c08 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:16.390020 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cc606d7aea34bf09af6ae2dd0f98902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:16.390619 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:16.390902 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:16.391190 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:16.399443 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:16.400921 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:16.410159 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1464/2903] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:18.052721 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:18.053510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:18.053510 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:18.073452 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] MFA Rules not processed for user `8adef8e6dd904084add1b8ac6bb7e66d`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:18.074692 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:18.081686 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1440/2904] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:18.323054 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:18.332586 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba13aa2-5017-4d44-931b-32055447cbc9 service cinder] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:18.336197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:18.336789 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:18.337070 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:18.337346 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:18.339304 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:18.348813 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:18.350237 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:18.359173 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1465/2905] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:18.775554 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:18.778021 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:18.848358 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1affe51-da8e-4e25-a8a2-303bda8fdb20 None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:18.853360 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512e223-a8ea-4507-9c78-899aae627d7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:18.853964 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512e223-a8ea-4507-9c78-899aae627d7a service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:18.854242 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512e223-a8ea-4507-9c78-899aae627d7a service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:18.855146 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512e223-a8ea-4507-9c78-899aae627d7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:18.856944 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-e512e223-a8ea-4507-9c78-899aae627d7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:18.868440 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512e223-a8ea-4507-9c78-899aae627d7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:18.870109 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512e223-a8ea-4507-9c78-899aae627d7a service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:18.879896 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1441/2906] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:28.325146 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:28.326609 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:28.359439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:28.400335 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de762-4606-4809-8dd3-4da8b9d52d73 service neutron] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:28.406563 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89cfa7e2f08741d4938a017990b8b031', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:28.408714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:28.408714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:28.408714 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:28.409439 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:28.422810 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:28.424549 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:28.438023 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1466/2907] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:28.875901 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=42 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:36.400339 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] REQUEST_METHOD: `POST` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:36.400925 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:36.401032 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:36.421542 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.auth.core [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] MFA Rules not processed for user `8adef8e6dd904084add1b8ac6bb7e66d`. Rule list: `[]` (Enabled: `True`). {{(pid=81749) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:36.423781 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:36.429887 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1442/2908] 10.222.0.45 () {58 vars in 958 bytes} [Thu Aug 25 05:26:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:36.658954 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:36.660435 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:36.672475 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc0545-b726-40e7-ac3b-9ec9a641da87 service nova] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:36.676094 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f55d-76a2-4d4d-920b-4208f9da9fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3819d2b7da64494f9ed77f670b7c23c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:36.676683 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f55d-76a2-4d4d-920b-4208f9da9fbe service neutron] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:36.676961 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f55d-76a2-4d4d-920b-4208f9da9fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:36.677234 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f55d-76a2-4d4d-920b-4208f9da9fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:36.678903 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f075f55d-76a2-4d4d-920b-4208f9da9fbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:36.688669 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f55d-76a2-4d4d-920b-4208f9da9fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:36.690099 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f55d-76a2-4d4d-920b-4208f9da9fbe service neutron] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:36.698200 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1467/2909] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:46.414969 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=3 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:46.694527 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=27 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:50.620760 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:50.622357 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:50.639769 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424af0ad-63e3-43ba-8775-03fa1539d83d None None] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:50.644802 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:50.645406 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:50.654987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:50.654987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:50.654987 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:50.660373 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:50.661992 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:50.673243 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1443/2910] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:26:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:26:57.127994 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07d25-7791-470c-a781-a59cc0f711a0 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:57.128531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07d25-7791-470c-a781-a59cc0f711a0 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:57.128531 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07d25-7791-470c-a781-a59cc0f711a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:57.177057 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-1ba07d25-7791-470c-a781-a59cc0f711a0 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:26:57.178261 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-1ba07d25-7791-470c-a781-a59cc0f711a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:57.245647 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1468/2911] 10.222.0.45 () {58 vars in 1009 bytes} [Thu Aug 25 05:26:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:26:57.401566 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:26:57.403018 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:26:57.494089 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3f936-ec71-4a91-92c5-9676dbb882da service placement] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:26:57.499858 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:26:57.500446 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:26:57.500726 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:26:57.500998 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:26:57.509211 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:26:57.511324 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:26:57.519302 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1444/2912] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:26:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:27:07.241879 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=40 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:07.516134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=47 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:14.762821 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3065014-d816-4727-b729-7e38eb22cab4 None None] REQUEST_METHOD: `POST` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:27:14.763263 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3065014-d816-4727-b729-7e38eb22cab4 None None] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:27:14.763372 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3065014-d816-4727-b729-7e38eb22cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:27:14.782663 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.auth.core [None req-f3065014-d816-4727-b729-7e38eb22cab4 None None] MFA Rules not processed for user `6e73a2cbe56e4cc7b8d52e53300bd809`. Rule list: `[]` (Enabled: `True`). {{(pid=81750) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 05:27:14.783900 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-f3065014-d816-4727-b729-7e38eb22cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:27:14.790992 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1469/2913] 10.222.0.45 () {58 vars in 967 bytes} [Thu Aug 25 05:27:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 05:27:14.804129 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:27:14.816484 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c614f-967f-4591-affd-2f43a36ce5fa service swift] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:27:14.821923 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3101f5b8db404c0893687ad8cc51bb4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:27:14.822533 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:27:14.822813 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:27:14.823153 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:27:14.831677 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:27:14.833301 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:27:14.842327 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1445/2914] 10.222.0.45 () {60 vars in 1384 bytes} [Thu Aug 25 05:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 05:27:18.050258 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3065014-d816-4727-b729-7e38eb22cab4 None None] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:27:18.063332 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3065014-d816-4727-b729-7e38eb22cab4 None None] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:27:18.068577 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:27:18.069353 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] REQUEST_METHOD: `GET` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:27:18.069605 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:27:18.069880 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:27:18.071682 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.fernet_utils [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81750) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:27:18.084414 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:27:18.086018 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:27:18.097197 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1470/2915] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:27:18.163286 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:27:18.174183 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3da5d1-f16d-43eb-8242-4b2195114815 service swift] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:27:18.178922 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:27:18.179543 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:27:18.179837 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:27:18.180193 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] PATH_INFO: `/v3/users/8adef8e6dd904084add1b8ac6bb7e66d` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:27:18.181224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8adef8e6dd904084add1b8ac6bb7e66d)` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:27:18.183134 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:27:18.363552 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8adef8e6dd904084add1b8ac6bb7e66d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.364224 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8adef8e6dd904084add1b8ac6bb7e66d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.364827 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8adef8e6dd904084add1b8ac6bb7e66d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.442427 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8adef8e6dd904084add1b8ac6bb7e66d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.450188 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.notifications [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8adef8e6dd904084add1b8ac6bb7e66d'} {{(pid=81749) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.468526 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1446/2916] 10.222.0.45 () {58 vars in 1224 bytes} [Thu Aug 25 05:27:18 2022] DELETE /identity/v3/users/8adef8e6dd904084add1b8ac6bb7e66d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:27:18.718039 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] Authenticating user token {{(pid=81750) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:27:18.728841 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbae008-2b14-4644-8fa0-7a646fc02e95 service placement] Validating token access rules against request {{(pid=81750) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:27:18.791842 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dde84621695a4b64985c2f72dbefe3be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aab57a271ef4e04a301d0c13f37422d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81750) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:27:18.792415 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:27:18.792698 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:27:18.793035 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] PATH_INFO: `/v3/projects/cf0283392ca34e1bb0a40d097dbd0118` {{(pid=81750) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:27:18.794927 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0283392ca34e1bb0a40d097dbd0118)` {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:27:18.796996 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] RBAC: Authorization granted {{(pid=81750) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:27:18.899571 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0283392ca34e1bb0a40d097dbd0118', 'request_id': 'req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.906504 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0283392ca34e1bb0a40d097dbd0118', 'request_id': 'req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.961545 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0283392ca34e1bb0a40d097dbd0118', 'request_id': 'req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d'} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.972760 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] The token cache is being invalidate because project cf0283392ca34e1bb0a40d097dbd0118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81750) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 05:27:18.973052 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.973681 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG keystone.notifications [None req-3f1ff3f2-7ec7-4844-8bd3-b3a534951b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81750) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 05:27:18.975175 dv-cinder-853910-2-smb devstack@keystone.service[81750]: [pid: 81750|app: 0|req: 1471/2917] 10.222.0.45 () {58 vars in 1233 bytes} [Thu Aug 25 05:27:18 2022] DELETE /identity/v3/projects/cf0283392ca34e1bb0a40d097dbd0118 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 05:27:28.464395 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:28.969799 dv-cinder-853910-2-smb devstack@keystone.service[81750]: DEBUG dbcounter [-] [81750] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81750) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:56.568630 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Authenticating user token {{(pid=81749) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 05:31:56.570036 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:31:56.711844 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc2781-4a4d-4886-8d23-6d36af0200a8 admin admin] Validating token access rules against request {{(pid=81749) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 05:31:56.769973 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842f9cb-55c4-4fc7-a17b-391551c38580 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f5a7148e3c4598ba93d35af2d564aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '979e597d43214098951310b4e2c09a31', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81749) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 05:31:56.770581 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f9cb-55c4-4fc7-a17b-391551c38580 service placement] REQUEST_METHOD: `GET` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 05:31:56.770862 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f9cb-55c4-4fc7-a17b-391551c38580 service placement] SCRIPT_NAME: `/identity` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 05:31:56.771135 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842f9cb-55c4-4fc7-a17b-391551c38580 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81749) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 05:31:56.772898 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.fernet_utils [None req-0842f9cb-55c4-4fc7-a17b-391551c38580 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81749) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 05:31:56.784266 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842f9cb-55c4-4fc7-a17b-391551c38580 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 05:31:56.786219 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842f9cb-55c4-4fc7-a17b-391551c38580 service placement] RBAC: Authorization granted {{(pid=81749) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 05:31:56.799658 dv-cinder-853910-2-smb devstack@keystone.service[81749]: [pid: 81749|app: 0|req: 1447/2918] 10.222.0.45 () {60 vars in 1365 bytes} [Thu Aug 25 05:31:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 05:32:06.794451 dv-cinder-853910-2-smb devstack@keystone.service[81749]: DEBUG dbcounter [-] [81749] Writing DB stats keystone:SELECT=89 {{(pid=81749) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}